Data Integration Engineer Job in Bangalore at McAfee

McAfee is hiring for the role of Data Integration Engineer

Responsibilities of the Candidate:

• Integrate data from a variety of source systems and knowledge to tailor integration approaches on a per-system basis.
• Liaise with Technical Data Steward and understanding business requirements for ingestion and integration.
• Document ingestion and integration flows and pipelines.
• Use Airflow to schedule and automate ingestion jobs.
• Manage metadata and master data in technical data catalog.
• Manage, maintain, and oversee ETL/ELT pipelines on the Databricks platform.
• Ensure ELT/ETL design meets required security and compliance guidelines, and ensure PII management, flagging, and risk assessment during ingestion and integration.
• Conduct pipeline monitoring.
• Ensure adherence to SDLC best practices.

Requirements:

• Bring 5+ years of experience in data engineering, ingestion pipelining, and ETL/ELT.
• Hands-on experience with and understanding of Spark/Scala, SQL, Python/PySpark, Databricks, ETL/ELT development using tools like Apache Airflow, omibo, data quality guidelines, CI/CD pipelines, Agile, and Git/version control.
• Good to have AWS cloud experience.