Data Engineer Job in Pune at UBS

UBS is hiring for the role of Data Engineer!

Responsibilities of the Candidate: 

• Engineer reliable data pipelines for sourcing, processing, distributing, and storing data in different ways, using cloud data platform infrastructure effectively.
• Transform data into valuable insights that inform business decisions, making use of our internal data platforms and applying appropriate analytical techniques.
• Develop, train, and apply data engineering techniques to automate manual processes, and solve challenging business problems.
• Ensure the quality, security, reliability, and compliance of our solutions by applying our digital principles and implementing both functional and non-functional requirements.
• Build observability into our solutions, monitor production health, help resolve incidents, and remediate the root cause of risks and issues.
• Understand, represent, and advocate for client needs.
• Codify best practices, and methodology and share knowledge with other engineers in UBS.
• Shape the Reference Data Mastering and Distribution architecture and technology stack within our new cloud-based datalake-house.

Requirements: 

• Experience in Distributed Processing using Databricks (preferred), Apache Spark
• Meaningful experience with Scala
• Ability to debug using tools like Ganglia UI, expertise in Optimizing Spark Jobs
• Experience and interest in Cloud platforms such as Azure (preferred) or AWS
• The ability to work across structured, semi-structured, and unstructured data, extracting information and identifying linkages across disparate data sets
• Expert in creating data structures optimized for storage and various query patterns for e.g. Parquet and Delta Lake
• Meaningful experience in at least one database technology such as: - Traditional RDBMS (MS SQL Server, Oracle, PostgreSQL) - NoSQL (MongoDB, Cassandra, Neo4J, CosmosDB, Gremlin)
• Understanding of Information Security principles to ensure compliant handling and management of data
• Experience in traditional data warehousing / ETL tools (Azure Data Factory, Informatica)
• Proficient at working with large and complex code bases (Github, Gitflow, Fork/Pull Model) and development tools like IntelliJ, working experience in Agile methodologies (SCRUM, XP, Kanban)