Data Engineer II Job in Mumbai at Shaadi.com

Shaadi.com is hiring for the role of Data Engineer II!

Responsibilities of the Candidate:

• Build scalable and reliable data pipelines
• Develop and maintain real-time data streaming systems
• Clean, organize and structure datasets for analytical and product use
• Create and optimize ETL processes for high-quality data flow
• Collaborate with engineering, analytics, data science and product teams for data requirements
• Ensure data availability, consistency and reliability across systems
• Design solutions to transform raw data into usable insights
• Maintain documentation and follow best practices in data engineering

Requirements:

• Technical Requirements / Skills
  • Proficiency in Python
  • Experience with AWS Glue, S3, Redshift, CloudFormation, ECS
  • Hands-on experience with Kafka and real-time streaming
  • Understanding of microservices architecture
  • Strong knowledge of Git, version control and CI/CD workflows
  • Solid grasp of data structures, system design and analytics
  • Experience building and optimizing ETL pipelines
  • Ability to work with large-scale distributed data systems
• Bonus (Good to Have)
  • Experience working with data lakes
  • Interest or experience in schema evolution
  • Enjoyment of solving debugging issues efficiently
  • Creative or humorous approach to tackling tech challenges (like memes)