Data Engineer Job in Bengaluru at Sparkcognition
Interview with HRs instantly—live now.
Skip applications. Get hired faster in Live Rooms.
Join instant video interviews
Data Engineer
Sparkcognition
Full Time Job
Not Disclosed
2-5 years
Posted 30+ days ago
Location
- Bengaluru
Skills Required
- Python
- Hadoop
- Spark
- Kafka
About this Job
Sparkcognition is hiring for the role of Data Engineer!
Responsibilities of the Candidate:
- Bringing large volumes of data from wind, solar, and storage sites to the cloud
- Architecting scalable data ETL and MLOps pipelines and workflows
- Working on engineering projects to design, construct, install, test, and maintain highly scalable data management systems
Requirements:
- Graduate with a degree in Computer Science, Statistics, Informatics, Information Systems, or another quantitative field
- Experience with Python
- 2+ years of experience building and optimizing big data pipelines, architectures, and data sets. Startup experience is a plus
- Experience building ETL pipelines from large disconnected datasets
- Experience with big data tools: Hadoop, Spark, Kafka, etc.
- Experience with relational databases such as Postgres
- Experience with Elasticsearch is a plus
- Experience in renewable energy or IoT time series data
- Experience in workflow orchestration technologies like Airflow or Prefect
- Experience with AWS cloud services: EC2, EMR, S3, RDS, Redshift or experience with GCP
Eligible Degrees
+86 More
Who can apply
Documents Required
1. Resume
2. ID Proof (e.g. Aadhar Card, PAN Card, etc.)
About Sparkcognition
Not ready to apply yet?
Explore Live Hiring Rooms and interview with HRs instantly - no waiting, no lengthy applications!
🔴 Live Now
23
Active Rooms
47
HRs Online
Priya S.
Got hired in 2 hours!
"Joined a Live Room at 2pm, interviewed instantly, and got the offer by 4pm. This is revolutionary!"
Stand out and get shortlisted up to 10X more
⚡ How Live Rooms Work
Browse live hiring rooms
Click to join - HR is waiting
Interview instantly, get hired faster
🔥 3 new rooms opened in the last 10 minutes!
Recommended Jobs For You
Not ready to apply yet?
Explore Live Hiring Rooms and interview with HRs instantly - no waiting, no lengthy applications!