Big Data Engineer Job in Bengaluru at Fractal

Fractal is hiring for the role of Big Data Engineer!

Responsibilities of the Candidate:

• Building horizontally scalable applications using distributed technologies like NoSQL, DBS/Hadoop, Spark, and others, and we execute projects on-premise and cloud-based systems
• Working on scaling AI systems and building end-to-end productionized MLOps pipelines
  

Requirements:

• Big Data, Hadoop, SCALA, Spark, Data mining, Hive, and Impala
• Strong understanding and experience in distributed computing frameworks particularly Apache Hadoop, YARN MapReduce HDFS, and associated technologies, one or more of Hive Oozie Impala, etc
• Expert-level proficiency in Spark, Pyspark, or Scala
• Experience in at least one of Java or Python preferred
• Hands-on experience with Apache Spark and its components’ Streaming SQL MLLib is a strong advantage
• Experience working within a Linux computing environment and using command-line tools, including knowledge of Shell Python scripting for automating common tasks
• Ability to work in a team in an agile setting; understanding of Git or any version control tools
• Kafka and Spark Streaming is pluses
• Hadoop (Hive, Impala, Kudu, HDFS, Map Reduce, etc.), Java, Spark, Python