Staff Engineer - Big Data Job in Pune at Seagate

Seagate is hiring for the role of Staff Engineer - Big Data!

Responsibilities of the Candidates:

• Responsible for developing and maintaining Big Data and advanced analytics platforms at Seagate
• Apply hands-on subject matter expertise in the Architecture of and administration of Big Data platforms
• Develop and manage SPARK ETL Frameworks, Data orchestration with Airflow, and support building PRESTO/Trino queries for the key stakeholders
• Design, scale, and deploy Machine Learning pipelines
• Collaborate with Application Architects and Business SMEs to design and develop end-to-end data pipelines and supporting infrastructure
• Establish and maintain productive relationships with peer organizations, partners, and software vendors
• Work with customers and business stakeholders to understand their needs and deliver on their highest priority features and requirements incrementally
• Work with PMO and effectively communicate with the management team on the platform charter and scope
• Manage budget responsibilities, development of staff, resource planning, and goal setting for the team
• Provide guidance, career development, and mentoring to technical team members, and help achieve maximum potential

Requirements:

• Graduation degree in engineering or equivalent
• 2+ Years of advanced experience and hands-on architecture and administration experience on big data platforms
• Understanding of Big data processing frameworks like Spark, Hadoop, Hive, Kafka, and EMR
• Knowledge of Python, Java, Scala, DevOps, Continuous Delivery, and Agile development
• A strong understanding of Micro-services and container-based development using Docker and Kubernetes ecosystem is a plus
• Experience working in a Software Product Development environment is a plus
• Excellent technical skills with a proven and successful history working with data at scale and empowering organizations through data