Data Engineer - I Job in Bangalore at KhataBook

Khatabook is hiring for the role of Data Engineer - I!

Responsibilities of the Candidate:

• Work on translating business needs to technical specifications and implement all stages right from data acquisition to integration, both batch and real-time.
• Work with Different pieces of Data Engineering (Ingestion, Processing, Serving).
• Work on MLOps (Building self-serve systems around several model lifecycles) and working on the entire pipeline (from PoC to product ionization) of Model & Data Versioning and deployments.
• Work with Data Tools (CDC(Debezium/Kafka-Connect, Kafka, DBT, Airflow, Spark, Snowflake, Redash, Tableau) and Infra level tools (Kubernetes, Helm, Docker, Jenkins).
• Drive continuous improvements in moving, aggregating, profiling, sampling, and testing terabytes of data.
• Build data pipelines data processing tools and technologies in open source and proprietary products like MongoDB, Postgres, DynamoDB, Sftp etc.
• Develop and execute database queries and conduct analyses.
• Manage and maintain large-scale systems for various Model deployments, Rudderstack (With a load of ~3-4B events/month).
• Harness operational excellence & continuous improvement with a can-do attitude.

Requirements:

• 1+ years of experience with large-scale data delivery platforms, working on modern data systems to support exponential data growth
• Experience with programming languages like Python, Java & scripting in Bash
• Strong SQL optimization and performance tuning experience in a high-volume data environment that utilizes parallel processing
• Experience with version control systems (Github), deployment tools (Jenkins) and cloud platforms (AWS, GCP)
• Ability to work effectively in an unstructured and fast-paced environment both independently and in a team setting, with a high degree of self-management with clear communication and commitment to delivery timelines
• Experience with Kubernetes is good to have