Lead Data Engineer
Bengaluru, KA, India
INR 2000K-3000K (estimate) Senior-level Full Time
Tasks
- Build and maintain data pipelines
- Build event driven real time data processing
- Coach and mentor engineers through code reviews
- Deliver CI CD with safe release and rollback
- Design analytical data models
- Design data-intensive applications
- Design end to end ingestion processing storage serving
- Develop backend services and APIs
- Implement observability logs metrics tracing alerts
- Lead architectural decisions and technology selection
- Support incident response and root cause analysis
- Translate business requirements into scalable systems
- Write testable maintainable Scala or Java
Perks/Benefits
- N/A
Skills/Tech-stack
Apache Kafka | Apache Spark | Automated testing | CI/CD | Concurrency | Data Modeling | Databricks | Distributed Systems | Event Driven | Event-driven architecture | Flink | Infrastructure as Code | JVM | JVM Tuning | Java | Kubernetes | Observability | PostgreSQL | Query Optimization | REST APIs | Scala | “as-code”
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Roles
Data Engineer | Engineer | Lead | Lead Data | Lead Data Engineer
Related jobs
-
Anthropic SDK | Embeddings | Fine Tuning | Git | GitHub ActionsCollaborative values led team | Exposure to global teams and customers | Generous holiday allowance | Hybrid work environment | Individual career developmentEntry-level Apprenticeship Full TimeWhitefield, Bangalore, India6h ago
-
Mid-level Full TimeMumbai, Maharashtra, India7h ago
-
Senior-level Full TimeMumbai, Maharashtra, India7h ago
-
Generative AI Engineer INR 1800K-3300KAI Studio | AWS SageMaker | Amazon Bedrock | Anthropic API | Azure AIGlobal consulting projects | Leadership trainingMid-level Full TimeMumbai, Maharashtra, India7h ago
-
Software Development Senior Associate INR 2000K-4500KAmazon Web Services | Artificial Intelligence | CI/CD | Data Analysis | DockerCareer growth opportunities | Certification support | Collaborative work environment | MentorshipSenior-level Full TimeChennai, TN, IN7h ago
-
Lead Data Engineer (OIC+Python) INR 2817K-4064KAPI Management | Apache Airflow | Cloud Composer | Cloud infrastructure | Cloud platformSenior-level Full TimeHyderabad, India8h ago
-
Sr. Software Engineer L4 INR 2500K-4000KAutomation | C plus plus | Cause analysis | Distributed Systems | File systemsSenior-level Full TimePune, MH, India10h ago
-
Senior Data Engineer - Python Job INR 2000K-3500KAmazon Web Services | CI/CD | Data Governance | Data Lineage | Data ModelingContinuous learning | Flexible work arrangements | Inclusive team environment | Stable employment | Team knowledge sharingSenior-level Full TimeBangalore, KA, IN14h ago
-
Principal Specialist- Data Science Customer Programs INR 3000K-4000KApache Spark | Data Engineering | Data Governance | Data Lineage | Data ModelingHybrid work environment | UK shift working hoursSenior-level Full TimeIN-KA-BENGALURU-NORTHGATE ~ Sy No 2/2 Venkatala … R14h ago
-
Senior-level Full TimeBangalore, KA, IN14h ago
-
Senior-level Full TimeBangalore, KA, IN14h ago
-
Senior-level Full TimeBangalore, KA, IN14h ago
-
Mid-level Full TimeGurgaon, HR, IN, 12200214h ago
-
Custom Software Engineer INR 1500K-2400KCloud Storage | Data Modeling | Data integration | Database Design | DatabricksMid-level Full TimeBengaluru, BDC7A, India14h ago
-
SEI - Data Migration Engineer (SWP) (Expanded Resources) INR 2400K-3380KApache Airflow | CI/CD | Cx Oracle | DBT Core | Data PumpSenior-level Full TimeBangalore, KA, IN14h ago
-
SEI - Data Migration Engineer (IMS) (Expanded Resources) INR 2520K-3880KApache Airflow | CI/CD | Cx Oracle | DBT | Data PumpSenior-level Full TimeBangalore, KA, IN14h ago
-
Specialist, Data Streaming Platform Engineer INR 2040K-2800KAirflow | Amazon Web Services | Apache Kafka | CI/CD | Confluent CloudDomestic relocation | Hybrid work arrangement | No travel requiredSenior-level Full TimeIND - Telangana - Hyderabad (Gachibowli …14h ago
-
SEI - Data Migration Engineer (IMS) (Expanded Resources) INR 2520K-3880KApache Airflow | Bulk Insert | CI/CD | Cx Oracle | DBT CoreSenior-level Full TimeBangalore, KA, IN14h ago
-
SEI - Data Migration Engineer (SWP) (Expanded Resources) INR 2400K-3380KApache Airflow | Bulk Insert | CI/CD | Cx Oracle | DBTSenior-level Full TimeBangalore, KA, IN14h ago
-
Developer or Technical Lead (Niche or Regular), Cloud Consultants, QA Tester, QA Lead, Data Migratio INR 2520K-3465KAgile Scrum | Azure DevOps | BPM | Background Processing | CI/CDSenior-level Full TimeBangalore, KA, IN14h ago
-
SEI - Data Migration Engineer (SWP) (Expanded Resources) INR 2400K-3380KApache Airflow | Bulk Insert | CI/CD | Cx Oracle | DBT CoreSenior-level Full TimeBangalore, KA, IN14h ago
-
Senior Specialist - Data Engineering INR 2800K-4000KAgile | Alteryx | Classification | Data Governance | Data MiningSenior-level Full TimeIND-CORP Gurugram-JBS- B2IT SEZ, India14h ago
-
Data Engineer II INR 1000K-2000KAmazon S3 | Apache Kafka | Apache Spark | CDC | CI/CDAutonomy | Inclusive and diverse environment | Learning stipend | Mentorship | Remote environmentMid-level Full TimeIndia - Remote R14h ago
-
None Full TimeIND-CORP Bengaluru-TDIM - PTT, India14h ago
-
Lead Data engineer, Sr. Specialist INR 2800K-3880KAWS | AWS Glue | AWS Lambda | Amazon Redshift | Amazon S3Domestic relocation | Flexible work arrangements | Hybrid work arrangements | Travel 10 percentSenior-level Full TimeIND - Telangana - Hyderabad, India15h ago