GCP-Data Engineer Job in Bengaluru at Fractal

Fractal is hiring for the role of GCP- Data Engineer!

Responsibilities of the Candidate:

• Design and develop data ingestion frameworks, real-time processing solutions, and data processing/transformation frameworks leveraging open source tools and data processing technologies.
• Hands-on experience with technologies such as Kafka, Apache Spark (SQL, Scala, Java), Python, Hadoop Platform, Hive, Presto, Druid, and Airflow.
• Demonstrate deep understanding of BigQuery architecture, including best practices and performance optimization.
• Proficiency in LookML for building data models and metrics.
• Experience working with DataProc for running Hadoop/Spark jobs on Google Cloud Platform (GCP).
• Knowledge of configuring and optimizing DataProc clusters for efficiency and performance.
• Provide system support as part of a support rotation alongside other team members.
• Operationalize open source data-analytic tools for enterprise-wide use.
• Ensure compliance with data governance policies by implementing or validating data lineage, quality checks, and data classification.
• Understand and adhere to the company’s development lifecycle to design, develop, deploy, and deliver robust data solutions.

Requirements:

• Bachelor's degree in Computer Science, Computer Information Systems (CIS), Engineering, Mathematics, or a related field, or equivalent practical experience.
• Experience or knowledge in software development life cycles (SDLC) and project involvement related to data engineering or cloud environments is preferred.