Data Engineer Job at Global Logic Technologies Private Limited

Global Logic Technologies Private Limited is hiring for the role of Data Engineer!

Responsibilities of the Candidate:

• Building out data pipelines
• Creating and supporting validation pipelines for continuous monitoring of the quality of data.
• Helping pinpoint and fix issues in data quality
• Collaborate with other outstanding engineers to power the most exciting digital experiences on the market
• Participating in code review sessions
• Following the client's standards for the code and data qualities

Requirements:

• Strong combined experience (3-5 years) in working with Python for analytics and/or data pipelines
• In-depth knowledge of SQL, optimization, and monitoring
• Practical experience with pySpark (Data frames, Pandas API, clustering)
• Strong programming experience in Python
• Practical experience with Apache Spark, and Hive
• Experience with working Apache Airflow and creating DAGs
• Hands-on experience with working with infrastructure in Git, Jenkins, and Docker. Pipelines creation experience
• Understanding the process of data ingestion
• Ability to document technical solutions and define development tasks accurately
• Desire to work collaboratively with your teammates to come up with the best solution to a problem
• Good english level (written/spoken) for daily communication within a distributed team and with business stakeholders