Lead Engineer Data Streaming
KA Bangalore, India
INR 2000K-3500K (estimate) Senior-level Full Time
Tasks
- Build and support data integration pipelines
- Design and implement scalable data platform solutions
- Ensure data platform reliability and performance
- Evaluate and adopt new data platform tools and technologies
- Implement CI CD pipelines and automation first practices
- Improve operational resilience with error handling replay and validation
- Lead technical design discussions
- Mentor engineers and promote engineering best practices
- Partner with platform engineering security and data governance teams
- Perform code reviews and production support
- Serve as escalation point for production issues
- Use infrastructure as code for environment provisioning
Perks/Benefits
- Career growth
- Flexible work environment
- Internal mobility
- Volunteering opportunities
- Wellbeing initiatives
- Work-life balance
Skills/Tech-stack
Ansible | Automation | CDC | CI/CD | Cloud Architecture | Code Reviews | Data Lakes | Data Streaming | Data Validation | Data Warehousing | Distributed Systems | Docker | ELT | ETL | Error Handling | Infrastructure as Code | Kafka | Kubernetes | Monitoring | Observability | Production Support | Python | Replay Capabilities | SQL | Striim | Terraform | Testing Frameworks | “as-code”
Education
Related jobs
-
Senior-level Full TimeIN-TN-Chennai13h ago
-
Manager - Data Engineering INR 804K-1500KAWS | Automation | Azure | Azure Data | Azure Data FactoryMid-level Full TimeBengaluru, KA, India13h ago
-
Senior Data Engineer INR 1500K-2500KAlerting | Apache Pinot | BigQuery | Cloud platform | Cost OptimizationSenior-level Full TimeBangalore, India14h ago
-
Senior Manager - C2 INR 3000K-5000KAI Observability | Docker | Embedding Models | Evaluation | Generative AISenior-level Full TimeGurugram, Haryana, India14h ago
-
Java Full Stack Engineer - Professional INR 1300K-2200KAmazon Web Services | Apache Kafka | AppDynamics | Automation | Cause analysisClient office work requirement | Hybrid work modelMid-level Full TimeIndia R15h ago
-
Executive-level Full TimeMumbai, Maharashtra, India15h ago
-
GenAI Engineer INR 1200K-2500KAWS | Artificial neural networks | Azure | Data Structures | DatabricksMid-level Full TimeIndia17h ago
-
Assistant Vice President - Program Delivery INR 4000K-5199KCollibra | Databricks | ETL | Hadoop | Power BIAnnual health checkup | Dental benefits | Gender neutral policy | Group term life insurance | Learning and development frameworkExecutive-level Full TimeGurugram, India17h ago
-
Bootloader | C# | CAN | Configuration Management | DebuggingFlexi benefits | Health insurance | Hybrid working model | Internal job rotation | Life insuranceEntry-level Full TimeBangalore, IN17h ago
-
Mid-level Full TimeBengaluru, KA, IN17h ago
-
Assistant Manager INR 1200K-2000KAPI Integration | CI/CD | Data Engineering | Data Governance | Data QualityMid-level Full TimeGurugram, Haryana, India18h ago
-
Executive-level Full TimeBangalore, Karnataka, India19h ago
-
AI Engineer II INR 3000K-5000KAWS | Agile | Apache Hive | Apache Kafka | Apache SparkCareer growth | Holistic well-being support | Learning opportunities | Supportive leadership cultureSenior-level Full TimeBengaluru, KA, India19h ago
-
Lead Data Quality Governance and Strategy Engineer INR 2520K-3380KBI tools | Data Governance | Data Management | Data Modeling | Data QualityFlexible hybrid work model | Health and life insurance | Paid time offSenior-level Full TimeHyderabad, India R19h ago
-
Senior Data Integration Engineer I INR 3264K-4401KAWS IAM | Airflow | Amazon VPC | Apache Flink | Apache SparkSenior-level Full TimeBengaluru20h ago
-
Senior Data Engineer I INR 2500K-3380KAgile | Apache Airflow | Apache Hadoop | Apache Hive | Apache KafkaInclusive culture | Professional development time | Supportive team environment | Work-life balanceSenior-level Full TimeGurugram, HR, India20h ago
-
Analytics Engineer INR 1500K-3000KDBT | Data Governance | Data Modeling | Git | MetaplaneCareer developmentMid-level Full TimeIndia20h ago
-
Data Engineer INR 1340K-1680KAWS | Azure | ClickHouse | DBT | Data ArchitectureDonation matching | Flexible PTO | Flexible schedule | Health insurance | Lunch stipendMid-level Full TimeBengaluru, Karnataka, India21h ago
-
Senior Analyst-Data Science INR 2500K-4400KA/B | A/B Testing | B testing | Causal Inference | Data PreparationSenior-level Full TimeGurugram, HR, India22h ago
-
IN_Associate_AI Engineer_GCC_Advisory_Hyderabad INR 2500K-4800KAPI Development | Anthropic API | Async Programming | Autogen | CI/CDFlexibility programmes | Inclusive benefits | Mentorship | Wellbeing supportSenior-level Full TimeHyderabad - Salarpuria, India1d ago
-
Data Engineer (SQL + Python/Java) INR 700K-1500KAWS EMR | Agile Scrum | Amazon Web Services | Apache Spark | Continuous DeliveryHybrid work flexibility | Remote work supportMid-level Full TimeGurgaon - Cyber Park, India1d ago
-
Lead Data Scientist INR 2520K-3500KA/B | A/B Testing | AWS | Agentic AI | Applied AIEmployee assistance program | Medical insurance | Paid time off | Parental leave | Professional developmentSenior-level Full TimeGurgaon - Cyber Park, India1d ago
-
IN_Sr Associate_ AWS Devops With MLOPs Developer_Application Technology_Advisory_ PAN INDIA (early joiners) INR 3000K-4000KAWS | AWS Lambda | Amazon CloudFormation | Amazon EKS | Amazon S3Flexibility programs | Inclusive benefits | Mentorship | Wellbeing supportSenior-level Full TimeBengaluru Millenia, India1d ago
-
Data Engineer - S/4 Analytics INR 2000K-2400KABAP RAP | AMDP | Access Control | Agile | Analytical ModelsFlexible working hours | Paid parental leave | Paid shift flexibility | Paid training and development programs | Remote work optionMid-level Full TimeBangalore RMZ-ECO WORLD, India1d ago
-
Vice President - Principal Data Engineer INR 3584K-5500KAPI | AWS | Agile | Anomaly Detection | AzureComprehensive healthcare | Flexible time off | Hybrid work model | Retirement plan | Support for working parentsSenior-level Full TimeM11 - Commers III, 43, 44 … R1d ago