Data Engineer Job in Bangalore at Target

Target is hiring for the role of Data Engineer!

Responsibilities of the Candidate:

• Assess client needs and convert business requirements into business intelligence (BI) solutions roadmap relating to complex issues involving long-term or multi-work streams.
• Analyze technical issues and questions identifying data needs and delivery mechanisms
• Implement data structures using best practices in data modeling, ETL/ELT processes, Spark, Scala, SQL, database, and OLAP technologies
• Manage overall development cycle, driving best practices and ensuring development of high quality code for common assets and framework components
• Develop test-driven solutions and provide technical guidance and heavily contribute to a team of high caliber Data Engineers by developing test-driven solutions and BI Applications that can be deployed quickly and in an automated fashion.
• Manage and execute against agile plans and set deadlines based on client, business, and technical requirements
• Drive resolution of technology roadblocks including code, infrastructure, build, deployment, and operations
• Ensure all code adheres to development & security standards

Requirements:

• 4 year degree or equivalent experience
• 1+ years of software development experience preferably in a data engineering/Hadoop development (Hive, Spark etc.)
• Hands on Experience in Object Oriented or functional programming such as Scala / Java / Python
• Knowledge or experience with a variety of database technologies (Postgres, Cassandra, SQL Server)
• Knowledge with design of data integration using API and streaming technologies (Kafka) as well as ETL and other data Integration patterns
• Experience with cloud platforms like Google Cloud, AWS, or Azure. Hands on Experience on BigQuery will be an added advantage
• Good understanding of distributed storage(HDFS, Google Cloud Storage, Amazon S3) and processing(Spark, Google Dataproc, Amazon EMR or Databricks)
• Experience with CI/CD toolchain (Drone, Jenkins, Vela, Kubernetes) a plus
• Familiarity with data warehousing concepts and technologies.
• Maintains technical knowledge within areas of expertise
• Constant learner and team player who enjoys solving tech challenges with global team.
• Hands on experience in building complex data pipelines and flow optimizations
• Be able to understand the data, draw insights and make recommendations and be able to identify any data quality issues upfront
• Experience with test-driven development and software test automation
• Follow best coding practices & engineering guidelines as prescribed
• Strong written and verbal communication skills with the ability to present complex technical information in a clear and concise manner to variety of audiences