Data Engineer II Job in Noida at Microsoft

Microsoft is hiring for the role of Data Engineer II! 

Responsibilities of the Candidate:

• You will build frameworks to validate data quality and completeness, detect anomalies, enhance data pipeline resiliency, and support unit and integration testing.
• You will design and implement end-to-end software life cycles, encompassing design, development, CI/CD, service reliability, recoverability, and participation in agile development practices, including on-call rotation.
• You will write code to implement performance monitoring protocols across data pipelines, building visualizations and aggregations to monitor pipeline health. You’ll also implement solutions and self-healing processes that minimize points of failure across multiple product features.
• You will anticipate data governance needs, designing data modeling and handling procedures to ensure compliance with all applicable laws and policies.
• You will implement and enforce security and access control measures to protect sensitive resources and data.
• You will Perform database administration tasks, including maintenance, and performance monitoring.

Requirements

• 1+ years of demonstrated experience implementing data governance practices, including data access, security and privacy controls and monitoring to comply with regulatory standards.
• Experience with big data technologies such as: Hadoop, Hive, Spark.
• Experience with distributed database engines like Microsoft Synapse.
• This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter.