Data Engineer - Pyspark Job in Bengaluru at o9 Solutions

o9 Solutions is hiring for the role of Data Engineer!

About the Company:

At o9 Solutions, our mission is clear: be the Most Valuable Platform (MVP) for enterprises. With our AI-driven platform — the o9 Digital Brain — we integrate global enterprises’ siloed planning capabilities, helping them capture millions and, in some cases, billions of dollars in value leakage. But our impact doesn’t stop there. Businesses that plan better and faster also reduce waste, which drives better outcomes for the planet, too.

Requirements:

• 2 years of coding experience in Pyspark
• Worked with different aspects of the Spark ecosystem, including Spark SQL, DataFrames, Datasets, and streaming
• Overall 3-4 years of experience as a data engineer
• Deep understanding and experience in Pyspark and some experience in the data lake and delta tables
• Skilled in big data tools, building data pipelines, ETL design, and implementation
• Must have strong programming skills in Python. Scala is a plus
• Should be familiar with Python (especially libraries like Pandas). The candidate should perform performance tuning and use Pyspark to move data
• Experienced writing production-level code, optimizing data processing, identifying performance bottlenecks, and root causes, and resolving defects
• Collaborates effectively with cross-functional teams to achieve product goals
• Familiar with software development best practices (Git, CI/CD, Unit Testing)