Senior Data Engineer Job in Bengaluru at Fidelity India

Fidelity is hiring for the role of Senior Data Engineer!

Responsibilities of the Candidate:

• Design, develop and maintain scalable data pipelines and architectures to support data ingestion, integration and analytics
• Be accountable for technical delivery and take ownership of solutions
• Lead a team of senior and junior developers providing mentorship and guidance
• Collaborate with enterprise architects, business analysts and stakeholders to understand data requirements, validate designs and communicate progress
• Drive technical innovation within the department to increase code reusability, code quality and developer productivity
• Challenge the status quo by bringing the very latest data engineering practices and techniques

Requirements:

• Expert in leveraging cloud-based data platform (Snowflake, Databricks) capabilities to create an enterprise lake house.
• Advanced expertise with AWS ecosystem and experience in using a variety of core AWS data services like Lambda, EMR, MSK, Glue, S3.
• Experience designing event-based or streaming data architectures using Kafka.
• Advanced expertise in Python and SQL. Open to expertise in Java/Scala but require enterprise experience of Python.
• Expert in designing, building and using CI/CD pipelines to deploy infrastructure (Terraform) and pipelines with test automation. 
• Data Security & Performance Optimization:  Experience implementing data access controls to meet regulatory requirements. 
• Experience using both RDBMS (Oracle, Postgres, MSSQL) and NOSQL (Dynamo, OpenSearch, Redis) offerings. 
• Experience implementing CDC ingestion
• Experience using orchestration tools (Airflow, Control-M, etc...)
• Significant experience in software engineering practices using GitHub, code verification, validation, and use of copilots