Data Engineer Job in Bengaluru at Setu

Setu is hiring for the role of Data Engineer!

Responsibilities of the Candidate:

• Build and maintain scalable, fault-tolerant ETL pipelines on AWS / GCP, in Python / Spark
• Develop and manage dataset processes, ensuring reliability, efficiency and quality
• Evaluate business needs and objectives supporting analytics initiatives
• Identify and implement internal process improvements, automating manual processes
• Work with cross-functional teams (Data Science, Product, Business) to support data infrastructure and analytic needs
• Document data architecture, processes, and systems for cross-functional team use
• Advocate for and implement best practices in data engineering

Requirements:

• Strong written and oral communication skills with a keen analytical mind to make recommendations.
• A burning desire to learn and develop deep fintech expertise.
• 2-4 years of experience in data engineering or related roles
• Strong proficiency in relational and NoSQL databases
• Hands-on experience with AWS, GCP, including services like EKS, Sagemaker etc.
• Experience in designing and implementing ETL processes and scalable data pipelines, using tools like KubeFlow, MLFlow, Airflow, Apache Spark, etc.
• Familiarity with orchestration and monitoring tools
• Experience with CI/CD pipelines like GitLab
• Understanding of security compliances and best practices in handling privacy