Data Engineer Job in Bangalore at NTT DATA

NTT Data is hiring for the role of Data Engineer!

Responsibilities of the Candidate:

• Design, develop, and maintain scalable data pipelines and ETL processes using Databricks and Apache Spark.
• Collaborate with data engineers, analysts, and business stakeholders to understand requirements and deliver optimized solutions.
• Implement data transformations, cleansing, and enrichment for large datasets in cloud environments (Azure/AWS/GCP).
• Optimize Spark jobs for performance and cost efficiency in distributed computing environments.
• Ensure data security, compliance, and governance standards are met across all workflows.
• Troubleshoot and resolve issues related to data processing, integration, and performance bottlenecks.
• Develop reusable components and maintain version control using Git or similar tools.
• Document technical designs, workflows, and best practices for future reference and team enablement.

Requirements:

• Strong proficiency in Databricks, Apache Spark, and distributed data processing frameworks.
• Hands-on experience with Python or Scala for data engineering tasks.
• Solid understanding of SQL for querying and data manipulation.
• Experience with cloud platforms (Azure Data Lake, AWS S3, or GCP) and related services.
• Knowledge of ETL concepts, data warehousing, and data modeling techniques.
• Familiarity with CI/CD pipelines, Git, and DevOps practices for data solutions.
• Ability to optimize Spark jobs for performance and troubleshoot complex data issues.
• Good communication skills and ability to work independently in a remote environment during 2 PM – 11 PM IST shift.