Data Engineer (Python/Linux) Job in Bangalore at Siemens

Siemens is hiring for the position of Data Engineer (Python/Linux)

Responsibilities:

• Providing Expert Consultancy on establishing the big data warehouse supporting data analytics & ML on AWS
• Guides the development team (or supports implementation as hands-on) to achieve performance and cost targets.
• Python-based development of data parsers for technical data files incl. transactional data model implementation
• Proven experience in Linux development environments
• Responsible for the Creation of ETL Pipelines
• Responsible for designing and building new DataModels and optimizing existing data models
• Exploit the elasticity and agility of the cloud.
• Ownership of physical Data models of serving layer
• Responsible and accountable for pipeline reliability and availability.
• Responsible of Data analysis for troubleshooting and exploration
• Understand the meaning, domain, and context of the data.

Requirements of the candidate;

• Experience in the Design and implementation of robust end-to-end modern Data pipelines including sourcing and preparation.
• Expert Knowledge in SQL Programming
• Expert knowledge in Snowflake
• Expert Knowledge in Designing ETL Pipelines using tools like Azure Data Factory, SSIS Pipelines etc.
• Expertise in SQL and NoSQL Databases
• Data modeling and data warehousing for the data serving layer.
• Exposure to Multi-model data warehouse.
• Good understanding of Deployment Pipelines, DevOps and related tools/methods (e.g. Docker, Container technologies)
• Hands-on Experience in a Programming language like java, JavaScript or equivalent
• Experience in Azure/AWS/GCP cloud services would be an advantage.
• Hands-on experience in Pyspark/Scala Spark and Python programming.