Lead Engineer Data Streaming
KA Bangalore, India
INR 1500K-2400K (estimate) Senior-level Full Time
Tasks
- Align implementations with security and data governance standards
- Build and support data integration pipelines
- Conduct architecture reviews
- Create automated testing frameworks
- Design and implement scalable data streaming solutions
- Enhance operational resilience with error handling and replay
- Ensure reliability through observability and monitoring
- Evaluate and adopt new data platform tools
- Implement CDC and ETL ELT pipelines
- Implement CI/CD pipelines
- Improve system performance
- Lead technical design discussions
- Mentor engineers
- Troubleshoot production issues
- Use infrastructure as code
Perks/Benefits
Skills/Tech-stack
Amazon Redshift | Ansible | Apache Kafka | CDC | CI/CD | Cloud Architecture | Distributed Systems | Docker | ELT | ETL | Infrastructure as Code | Kubernetes | Monitoring | Observability | Oracle | PostgreSQL | Python | SQL | Snowflake | Striim | Terraform | Testing Frameworks | “as-code”
Education
Related jobs
-
Sr. Digital Solution Engineer - Data & Analytics INR 2520K-3380KAzure | Azure Data | Azure Data Factory | Azure SQL | Azure SynapseSenior-level Full TimeBengaluru, KA, IN; Mumbai, MH, IN6h ago
-
Mid-level Full TimeGurugram, Haryana, India8h ago
-
Sr. Software Engineer (AI/ML) (PhD / Postdoc) INR 1500K-2400KCausal Inference | Deep learning | Generative AI | Language Processing | Machine LearningAccess to large clinical dataset | Collaboration with healthcare partners | Conference publication support | Research freedomSenior-level Full TimeHyderabad, India8h ago
-
Mid-level Full TimeGurugram, Haryana, India9h ago
-
AI | AWS | Agile | Ansible | AutosysSenior-level Full TimeBengaluru, Karnataka, India9h ago
-
Business Intelligence Engineer, Last Mile Analytics INR 1800K-2400KAmazon QuickSight | Data Analysis | Data Interpretation | Data Visualization | NoSQLMid-level Full TimeHyderabad, Telangana, IND14h ago
-
IT Data Engineer II INT INR 1800K-2500KApache Spark | Cloud Cost Optimization | Cloud platform | Cost Optimization | Data GovernanceMid-level Full TimeBangalore, India14h ago
-
Data Engineer - VOIS INR 2000K-2040KApache Airflow | Apache Spark | BigQuery | CI/CD | Cloud ComposerCollaborative environment | Flexible inclusive workplace | Learning opportunitiesMid-level Full TimePune, IN14h ago
-
AWS CloudFormation | Amazon Kinesis | Amazon Redshift | Amazon S3 | Amazon Web ServicesEqual opportunity employer | Fast track growth opportunities | Great place to workSenior-level Full TimeHyderabad, Office Level 3 & 4, …14h ago
-
TTT-SAP-Python Gen AI-Tax Senior INR 2000K-4512KAI Core | AI Launchpad | API Management | CI/CD | Cloud ALMSenior-level Full TimeBengaluru, KA, IN, 56001614h ago
-
Entry-level Full TimeBangalore, India14h ago
-
Senior-level Full TimeBangalore, KA, IN14h ago
-
Deputy Manager, Global Platform Technology INR 1500K-2000KAgile | Azure Blob | Azure Blob Storage | Azure Cosmos | Azure Cosmos DBMid-level Full TimeChennai IMPT, India14h ago
-
Senior-level Full TimeIndia - Chennai14h ago
-
Data engineer (Azure Databricks) INR 1500K-2500KAmazon Web Services | Apache Airflow | Apache Kafka | Apache Spark | AzureMid-level Full TimeChennai, Tamil Nadu, India14h ago
-
Data Engineer INR 3000K-4000KAgile | Azure | Azure IAM | Azure Networking | Azure StorageBe Well programs | Certification support | Coaching | Continuous feedback | Hybrid workMid-level Full TimeINMANBP Bangalore (INMANBP) Manyatha, India14h ago
-
Data Engineering Lead - MSC INR 2520K-3380KAbinitio | Airflow | Azure Data | Azure Data Factory | Azure Data LakeRelocation supportSenior-level Full TimeBusiness Office (Joy House 2) - …14h ago
-
Associate Data Engineer INR 1500K-2000KAWS | CCPA | Data Architecture | Data Governance | Data ModelingMid-level Full TimeIndia - Hyderabad14h ago
-
Senior AI/ML Engineer INR 2500K-5000KAI Document Intelligence | AI Services | API Design | Agent Orchestration | Agent systemsSenior-level Full TimeBangalore - RGA Tech Park, India14h ago
-
Software Engineering LMTS- ML Engineer INR 2500K-4500KEmbeddings | Fine Tuning | LLM | Machine Learning | Machine Learning PipelinesSenior-level Full TimeIndia - Bangalore14h ago
-
Senior SQL Developer + SSIS + POWER BI INR 3000K-4000KAgile Scrum | BI Desktop | Composite Models | DAX | Data ModelingSenior-level Full TimeMumbai, India14h ago
-
Senior Manager, Biostatistical Programming INR 2535K-4144KAutomation | Clinical trials | Compliance | Data Quality | Offshore Team ManagementCareer development | Health benefits | Inclusive culture | Total rewards | Work-life balanceSenior-level Full TimeIndia - Hyderabad14h ago
-
Associate Database Reliability Engineer INR 1200K-2500KBash | CentOS | Cloud infrastructure | DNS | DRSMid-level Full TimePune, India14h ago
-
Software Development Engineer 1 INR 2200K-4200KAI Agents | AWS | Azure | CI/CD | DockerContinuous learning | Flexible experimentation | Innovation culture | Mentorship | Open collaborationNone Full TimeAPAC - India - Bengaluru - …14h ago
-
Software Development Engineer 4 INR 2500K-4500KAWS EMR | Airflow | Apache Spark | Data Ingestion | Data LakeSenior-level Full TimeNoida, India R14h ago