ETL Production Support Engineer Job in Chennai at Guardian

Guardian is hiring for the role of ETL Production Support Engineer!

Responsibilities of the Candidate:

• Provide production support and on-call support for all ETL platforms.
• Review and understand business data-related ETL requirements for database, application, and reporting projects.
• Develop and make enhancements to new and existing data systems.
• Participate in the development plans and resource estimation for task planning.
• Assist with the development of logical data models.
• Monitor production jobs and resolve any issues in a timely manner.
• Partner with other IT areas in resolving issues and improving processes.
• Develop Informatica or ETL workflows.
• Develop ETL code both in Informatica and at the shell script level.
• Design, build, and maintain automated data pipelines to ensure smooth data ingestion and integration from various sources.
• Develop scalable and efficient solutions for data ingestion, using best practices in ETL/ELT processes.
• Implement data validation and quality checks to ensure data integrity throughout the pipeline.
• Optimize data pipelines to handle large volumes of data in real-time and batch processing environments.
• Collaborate with data engineers, analysts, and other stakeholders to understand data requirements and deliver seamless solutions.
• Monitor pipeline performance, troubleshoot issues, and continuously improve pipeline efficiency.
• Document pipeline processes, configuration, and maintenance routines to facilitate knowledge sharing and onboarding.

Requirements:

• Proficient in ETL tools such as Precisely or Informatica.
• Knowledge of Datalake/Databricks concepts.
• Experience with Pyspark.
• Basic knowledge of SQL/Unix.
• Strong understanding of LakeHouse concepts, such as Delta format and workflow creation.
• Strong knowledge of ETL concepts, especially as applied to Informatica and Informatica cloud.
• Strong knowledge of data analysis, data transformation, conceptual data modeling, data transformation, and metadata management.
• Strong knowledge of data design for various applications.
• Strong knowledge of SQL.
• Good knowledge of various RDBMS and Mainframe.
• Good knowledge of project life cycle methodologies.
• Strong verbal and written communication skills.
• Strong knowledge of Unix and Unix Shell scripting.
• Experience with enterprise scheduling tools such as Control-M is a plus.