Data Engineer Job in Noida at Info Edge India Ltd.

Info Edge is hiring for the role of Data Engineer.

Responsibilities of the Candidate:

• Develop high-quality, secure, and scalable data pipelines using spark, Scala/ python on Hadoop, or object storage.
• Leverage new technologies and approaches to innovate with increasingly large data sets.
• Drive automation and efficiency in Data ingestion, data movement, and data access workflows by innovation and collaboration.
• Understand, implement, and enforce Software development standards and engineering principles in the Big Data space.
• Work closely with business stakeholders and embedded engineering teams within business teams in a collaborative manner to help them build scalable products in a quick time.
• Contribute ideas to help ensure that required standards and processes are in place and actively look for opportunities to enhance standards and improve process efficiency.
• Perform assigned tasks and production incidents independently.

Requirements:

• 1-3 years of experience
• Experience in building, and maintaining large-scale applications.
• Expertise in Python, spark, Hadoop/HDFS
• Experience in building data ingestion pipelines
• Understanding of RDBMS and NoSQL databases including wide-column databases
• Understanding of messaging systems e.g. Kafka, Pulsar
• Exposure to working with Pandas, Nump
• Ability to understand Business challenges and define solutions aligned to the needs.