Data Engineer - 1st Party Data Job in Bangalore at Eli Lilly & Company

Eli Lilly & Company is hiring for the role of Data Engineer - 1st Party Data!

Responsibilities of the Candidate:

• Create and maintain optimal data pipeline architecture ETL/ ELT into structured data
• Assemble large, complex data sets that meet business requirements and create and maintain multi-dimensional modelling like Star Schema and Snowflake Schema, normalization, de-normalization, joining of datasets.
• Expert level experience creating Fact tables, Dimensional tables and ingest datasets into cloud based tools.
• Identify, design, and implement internal process improvements including automating manual processes, optimizing data delivery and re-designing infrastructure for greater scalability.
• Setup and maintain data ingestion, streaming, scheduling, and job monitoring automation. Connectivity between Lambda, Glue, S3, Redshift, Power BI needs to be maintained for uninterrupted automation.
• Build analytics tools that utilize the data pipeline to provide actionable insight into customer acquisition, operational efficiency, and other key business performance metrics.
• Work with stakeholders to assist with data-related technical issues and support their data infrastructure needs.
• Create data tools for analytics and data scientist team members that assist them in building and optimizing our product into an innovative industry leader
• Collaborate with the CDP team to ensure seamless data integration into the CDP.
• Ensure data privacy and compliance with relevant regulations (e.g., GDPR) when handling customer data.
• Maintain data quality and consistency within the CDP, addressing data-related issues as they arise.

Requirements:

• Bachelor’s or master’s degree on Technology and Computer Science background
• 2-6 years of relevant experience
• Proven experience working with Customer Data Platforms (CDP) or Data Management Platform (DMP) or CRM tool is preferred.
• Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases and Cloud Data warehouse like AWS Redshift
• Data Model development, additional Dims and Facts creation and creating views and procedures, enable programmability to facilitate Automation.
• Data compression into PARQUET to improve processing and finetuning SQL programming skills required.
• Experience building and optimizing “big data” data pipelines, architectures and data sets.
• Experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement.
• Strong analytic skills related to working with structured and unstructured datasets.
• Working knowledge of message queuing, stream processing, and highly scalable “big data” stores.
• Experience supporting and working with cross-functional teams and Global IT.
• Familiarity of working in an agile based working models.