Software Engineer-Data Engineering Job in Bengaluru at Zeotap

Zeotap is hiring for the role of Software Engineer- Data Engineer!

Responsibilities of the Candidate:

• Design and implement robust, scalable, and high-performance data pipelines using Spark, Scala, and Airflow, with familiarity with Google Cloud.
• Develop, construct, test, and maintain architectures such as databases and large-scale processing systems.
• Assemble large, complex data sets that meet both functional and non-functional business requirements.
• Build the infrastructure required for optimal extraction, transformation, and loading (ETL) of data from various sources.
• Collaborate with data scientists and other stakeholders to enhance data models that drive business processes.
• Implement data flow and tracking using Apache Airflow.
• Ensure data quality and integrity across various data processing stages.
• Monitor and optimize the performance of data processing pipelines

Requirements:

• 2+ years of experience in building and deploying high scale solutions
• Must have very good problem-solving skills and clear fundamentals of DS and algorithms
• Expert coding skills in Java or Scala
• Expert coding skills in Go or Python is a huge plus
• Apache Spark or other Bigdata stack experience is a mandatory
• High level and low-level design skills.
• Deep understanding of any OLTP, OLAP, NoSQL or Graph databases is a huge plus.
• Deep knowledge of distributed systems and design is a huge plus
• Hands-on with Streaming technologies like Kafka, Flink, Samza etc is a huge plus
• Good knowledge of scalable technologies involving Bigdata technologies
• Bachelor or Master’s degree in information systems, computer science or other related fields is preferred