Lead Engineer Data Streaming
KA Bangalore, India
INR 1600K-3000K (estimate) Senior-level Full Time
Tasks
- Build and support end to end data integration pipelines
- Design and implement scalable data platform solutions
- Ensure high reliability and performance with observability
- Evaluate and adopt new tools and technologies
- Implement CI/CD pipelines and testing frameworks
- Improve operational resilience with error handling replay and validation
- Lead technical design discussions and architecture reviews
- Manage infrastructure as code and automation
- Mentor engineers
- Partner with security and data governance teams
- Troubleshoot production issues and optimize system performance
Perks/Benefits
- Flexible work environment
- Internal mobility
- Volunteering opportunities
- Well-being programs
- Work-life balance
Skills/Tech-stack
Amazon Redshift | Ansible | Apache Kafka | CDC | CI/CD | Cloud Architecture | Data Governance | Data Lake | Data Validation | Data Warehousing | Data integration | Database Administration | Distributed Systems | Docker | ELT | ETL | Infrastructure as Code | Kubernetes | Monitoring | Observability | Oracle | PostgreSQL | Python | SQL | Snowflake | Terraform | “as-code”
Education
Related jobs
-
Lead Software Engineer - Data Engineering INR 3500K-5000KAWS | Airflow | Authentication | Authorization | CI/CDSenior-level Full TimeBengaluru, Karnataka, India9h ago
-
Senior/Lead Data Scientist INR 3000K-5000KAPIs | Agents | Azure | Azure DevOps | CI/CDCareer development | Continuous learningSenior-level Full TimeBangalore, Karnataka, IN10h ago
-
Engineer - Digital & AI Solutions INR 302K-346KAWS | Agile | Azure | Big Data | Cloud platformCharity Programmes | Discounted gym memberships | Environmental initiatives | Flexible working | Hybrid workingEntry-level Full TimeHyderabad, Telangana, India11h ago
-
AI/ML Engineer_MS INR 2500K-5000KAI Foundry | AI Search | AWS Bedrock | Amazon QuickSight | App ServiceSenior-level Full Timetelengana, India12h ago
-
Data Analyst Technical Lead (Alteryx) INR 3000K-4000KAPI Integration | Alteryx Designer | Alteryx Server | Data Cleansing | Data ReconciliationUK shiftSenior-level Full TimeNoida, UP, India13h ago
-
Lead Data Analyst (OAC) INR 1500K-2500KAnalytics Cloud | BI Publisher | Data Modeling | Data Visualization | Data WarehousingShift workSenior-level Full TimeNoida, UP, India13h ago
-
Mid-level Full TimeBangalore, Karnataka, India13h ago
-
GCP Data Engineer INR 1500K-2000KAgile | Apache Airflow | Ascend.io | CI/CD | Cloud ComposerFlexible work model | Wellbeing cultureMid-level Full TimeHyderabad, India13h ago
-
Mid-level Full TimeBangalore, Karnataka, India13h ago
-
Senior AI & Automation Engineer (6+ years Generative AI, Agentic AI, LLMs, Python, APIs, MCP) INR 3700K-5500KAgent systems | Agentic AI | Agile | CI/CD | DockerSenior-level Full TimeBengaluru, KA, India13h ago
-
AWS | Adversarial Machine Learning | Amazon SageMaker | Anonymization | AzureCutting-edge AI security work | Flexible working hours | Fully remote | Global cross-functional collaboration | Opportunity to shape AI security best practicesSenior-level Full TimeIndia R14h ago
-
A/B | A/B Testing | AWS | Azure | B testingFlexible working hours | Flextime policy | Hybrid work model | International collaboration | Technical growth opportunitiesSenior-level Full TimeIndia14h ago
-
Senior Software Engineer, Machine Learning INR 2500K-3500KA/B | A/B Testing | Amazon S3 | Apache Airflow | Apache SparkAccident insurance | Commuter benefits | Dental insurance | Disability insurance | Financial wellness supportSenior-level Full TimeBengaluru, India14h ago
-
Manager Software Engineer- ML + NLP+ ppl management INR 3200K-4800KAPIs | BERT | Data Mining | Data Science | Deep learningFlexible work arrangements | Hybrid work environmentSenior-level Full TimeGurgaon - Cyber Park, India18h ago
-
Principal Engineer, Storage Data Science and Analytics INR 3200K-4590KAIOps | Anomaly Detection | Apache Spark | C# | C++Career Development Programs | Flexible work arrangements | Health and wellbeing benefitsSenior-level Full TimeBengaluru, Karnātaka, India18h ago
-
Principal Engineer, Storage Data Science and Analytics INR 3000K-3900KAIOps | Agentic Workflows | Anomaly Detection | C# | C++Senior-level Full TimeBengaluru, Karnātaka, India18h ago
-
Senior-level Full TimeBengaluru Office, India18h ago
-
Senior-level Full TimeBangalore, India R18h ago
-
Databricks -Project Lead-Data Engg INR 1500K-2500KAzure Data | Azure Data Factory | Azure Synapse | Azure Synapse Analytics | Data FactoryClient communication support | Flexible to work US shiftsSenior-level Full TimeINDIA - PUNE - BIRLASOFT OFFICE …18h ago
-
Technical Specialist-App Development INR 2000K-5000KAWS | Azure | Experiment tracking | Financial Reporting | Fraud DetectionSenior-level Full TimeINDIA - HYDERABAD - BIRLASOFT OFFICE, …18h ago
-
Senior Data Engineer (Data Analytics),Hyderabad INR 3000K-4000KAPI | AWS | Agile | Amazon DynamoDB | Amazon RedshiftEqual opportunity employer | Fast track growth opportunitiesSenior-level Full TimeHyderabad - Phoenix Equinox Tower 2, …18h ago
-
Data Engineer - Fabric Pipelines / Orchestration INR 2040K-3000KApache Spark | Azure Synapse | Data Quality | Data Warehousing | Data integrationContract employment | Quarterly renewal | Remote workSenior-level Full TimeDelhi, DL, IN18h ago
-
Databricks - Principal Data Engineer INR 1500K-2500KApache Spark | CI/CD | Data Modeling | Data Pipeline Performance Tuning | Data WarehousingFull-time employment | Hybrid workSenior-level Full TimeBangalore, KA, IN18h ago
-
AI/ML Engineer INR 2500K-4500KAWS | Azure | Cloud Computing | Computer Vision | Continuous DeploymentSenior-level Full TimePune [SNTPS Kharadi], India18h ago
-
Custom Software Engineer INR 2475K-3500KAzure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure SynapseSenior-level Full TimeBengaluru, BDC11A, India18h ago