BigData Engineer Job in Bangalore at Fractal

Fractal is hiring for the role of BigData Engineer!

Responsibilities of the Candidate:

• Evaluate, develop, maintain, and test big data solutions for advanced analytics projects.
• Perform big data pre-processing & reporting workflows, including collecting, parsing, managing, analyzing, and visualizing large sets of data to derive business insights.
• Test various machine learning models on big data and deploy learned models for ongoing scoring and prediction.
• Appreciate the mechanics of complex machine learning algorithms, providing a strong advantage.
• Demonstrate experience in designing technological solutions to complex data problems.
• Develop & test modular, reusable, efficient, and scalable code to implement solutions.
• Exhibit expert-level proficiency in at least one of Java, C++, or Python (preferred); strong Scala knowledge is advantageous.
• Understand and apply distributed computing frameworks, particularly Apache Hadoop 2.0 (YARN; MR & HDFS) and related technologies such as Hive, Sqoop, Avro, Flume, Oozie, Zookeeper, etc.
• Operate within cloud computing platforms, especially AWS (e.g., EMR, EC2, S3, SWF services) and utilize the AWS CLI effectively.
• Work proficiently in a Linux computing environment; adept at using command line tools and skilled in shell/Python scripting for task automation.
• Collaborate effectively in a team within an agile setting; familiar with tools like JIRA and possess a clear understanding of Git operations.

Requirements:

• Have hands-on experience with Apache Spark and its components (Streaming, SQL, MLLib); familiarity is highly valued.