Data Engineer Job in Bangalore at Loyalytics Consulting

Loyaltics is hiring for the role of Data Engineer!

Responsibilities of the Candidate:

• Analyse, and prepare statistical summaries, and high-level insights and identify gaps in data.
• Evaluate and control data quality, security, and privacy in all solutions.
• Clarify/translate requirements into Epics/Stories & remove ambiguity.
• Mentor other DE team members.
• Present and demo to groups/stakeholders of mixed technical ability.

Requirements:

• Understanding of core business intelligence/data warehousing technology and best practices: RDBMS, Big Data, Client/Server, OLAP, ML Skills
• Experience leading a technical team
• Moderate experience with client engagement & aligning them to your ideas/solutions
• 1-3 years building Data Warehouse/Data Lake Architecture and Development
• Strong documentation and structured communications are a must
• 1-3 years of Data Modelling & Flow and Architecture
• 1-3 years of Cloud data solutions like Azure (preferred)
• Expertise in SQL, Python & Pyspark
• Building and operationalizing ETL/ELT Pipelines using custom and packaged tools such as Azure Data Factory, Airflow or equivalent
• Spark-based platforms such as Databricks, and Hadoop experience
• Cluster configurations including scaling, pooling, memory, and cost optimizations
• Data prep, migration, analysis, gaps, visualization, auditing etc.
• RDBMS such as MS SQL server, Oracle, Aurora, and PostgreSQL
• Good to have:
  • DevOps tools such as Azure DevOps, Log Analytics, and monitoring
  • NoSQL data platforms such as Cosmos DB, Cassandra, Graph DB, etc.
  • Messaging technologies such as Kafka, Event Hub etc.
  • API and client development and deployment experience
  • Experience integrating with BI technologies such as PowerBI, Tableau