Data Engineer - Data sourcing & Solutions Job in Bangalore at AXA XL

AXA XL is hiring for the role of Data Engineer - Data Sourcing & Solutions!

Responsibilities of the Candidate:

• Exploring and acquiring new sources of data.  Using curiosity and creativity, would involve using technology to automate data acquisition, the ability to link new sources with internal data, and an appropriate level of supporting documentation of the source and technical solution.
• Ensuring quality and understanding of analytical data.  This would require hands-on data experience to investigate data issues and seek to resolution or acceptance.  Create the appropriate amount of documentation, leverage standards and build upon them.  Data should be reconciled and documented at various stages for integrity.
• Participate in developing governance and rigour of data management practice within the Data Sourcing & Solutions Team.  This will also include partnering with enterprise IT groups and involvement in enterprise data-related functions.

Requirements:

• College Degree in MIS, Information Technology, Computer Science, Engineering, Statistics, Mathematics, Actuarial Science or equivalent.
• Relevant years of experience is required.
• Sound understanding/experience of Python, Spark, Databricks PySpark/Spark SQL and best practices
• Effective SQL Skills knowledge is required.
• Data development experience using data development / Analysis tools.
• Expertise in Star Schema data modelling.
• Experience working on building /optimizing logical data models and data pipelines while delivering high-data-quality solutions that are testable and adhere to SLAs.
• Development experience using R(Data structures, Plumber, Shiny)  a plus point.
• Familiarity with developer support tools (TFS/GIT, Jenkins) a plus.