Senior Data Engineer Job in Pune at Barclays

Barclays is hiring for the role of Senior Data Engineer!

Responsibilities of the candidate: 

• Build and maintenance of data architectures pipelines that enable the transfer and processing of durable, complete and consistent data.
• Design and implementation of data warehoused and data lakes that manage the appropriate data volumes and velocity and adhere to the required security measures.
• Development of processing and analysis algorithms fit for the intended data complexity and volumes.
• Collaboration with data scientist to build and deploy machine learning models.

Requirements: 

• Hands on experience to work with large scale data platforms & in development of cloud solutions in AWS data platform with proven track record in driving business success.
• Strong understanding of AWS and distributed computing paradigms, ability to design and develop data ingestion programs to process large data sets in Batch mode using Glue, Lambda, S3, redshift and snowflake and data bricks.
• Ability to develop data ingestion programs to ingest real-time data from LIVE sources using Apache Kafka, Spark Streaming and related technologies. Hands on programming experience in python and PY-Spark.
• Understanding of Dev Ops Pipelines using Jenkins, GitLab & should be strong in data modelling and Data architecture concepts & well versed with Project management tools and Agile Methodology.
• Sound knowledge of data governance principles and tools (alation/glue data quality, mesh), Capable of suggesting solution architecture for diverse technology applications.