Data Engineer - Gen AI - Associate 2 Job in Bangalore at PricewaterhouseCoopers (PwC)

PricewaterhouseCoopers is hiring for the role of Data Engineer - Gen AI - Associate 2!

Responsibilities of the Candidate:

• Assist in the design, development, and maintenance of data pipelines and ETL processes for GenAI projects.
• Work closely with data scientists and software engineers to support the implementation of machine learning models and algorithms.
• Optimize data infrastructure and storage solutions to ensure efficient data processing.
• Gain experience with event-driven architectures to enable real-time data processing and analysis.
• Learn and assist with containerization technologies like Kubernetes and Docker for deployment and scalability.
• Support the development and maintenance of data lakes for managing large volumes of structured and unstructured data.
• Contribute to the integration of LLM frameworks (such as Langchain and Semantic Kernel) for advanced language processing and analysis.
• Collaborate with cross-functional teams to support the design and implementation of solution architectures for GenAI projects.
• Utilize cloud computing platforms such as Azure or AWS under supervision for data processing, storage, and deployment.
• Participate in monitoring and troubleshooting of data pipelines and systems to ensure smooth operations.
• Stay informed about the latest advancements in GenAI technologies and assist in recommending innovative solutions to enhance data engineering processes.
• Engage with cross-functional teams to help understand business requirements and contribute to translating them into technical solutions.
• Assist in documenting data engineering processes, methodologies, and best practices.

Requirements:

• Bachelor’s degree in Computer Science, Data Science, or a related field
• 1-3 years of relevant experience, ideally with some exposure to GenAI projects
• Basic programming skills in Python
• Familiarity with data processing frameworks like Apache Spark or similar
• Understanding of SQL and basic database management systems
• Some knowledge of event-driven architectures and real-time data processing
• Exposure to containerization technologies like Kubernetes and Docker
• Awareness of data lakes and basic data lake management principles
• Some familiarity with LLM frameworks such as Langchain and Semantic Kernel
• Experience with cloud computing platforms such as Azure or AWS is a plus
• Strong analytical and problem-solving skills
• Good communication and collaboration abilities
• Ability to work in a fast-paced and dynamic environment