Lead Engineer Data Streaming
KA Bangalore, India
INR 2000K-3000K (estimate) Senior-level Full Time
Tasks
- Align implementations with security and data governance standards
- Build data streaming and CDC pipelines
- Design scalable data platform solutions
- Develop ETL and ELT pipelines
- Ensure platform reliability through observability and monitoring
- Evaluate and adopt new data platform technologies
- Implement CI/CD pipelines and infrastructure as code
- Implement end to end data integration pipelines
- Improve resilience with error handling replay and validation
- Lead technical design discussions and architecture reviews
- Mentor engineers and promote engineering best practices
- Troubleshoot production issues and optimize performance
Perks/Benefits
- Flexible work environment
- Internal mobility
- Volunteering opportunities
- Wellbeing support
- Work-life balance
Skills/Tech-stack
Amazon Redshift | Ansible | CDC | CI/CD | Cloud Architecture | Data Lake | Data Streaming | Data Warehouse | Distributed Systems | Docker | ELT | ETL | Error Handling | Infrastructure as Code | Kafka | Kubernetes | Monitoring | Observability | Oracle | PostgreSQL | Python | Replay | SQL | Snowflake | Striim | Terraform | Testing Frameworks | “as-code”
Education
Related jobs
-
Sr Developer Software INR 2000K-4000KAWS | AWS Glue | AWS Lambda | Amazon ECS | Amazon EMRFlexible work environment | Internal mobility | Volunteering opportunities | Well-being | Work-life balanceSenior-level Full TimeKA Bangalore, India9h ago
-
Data Architect INR 1500K-2600KApache Kafka | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageSenior-level Full TimeBangalore North, India17h ago
-
Senior AI/ML Engineer INR 3799K-5572KAI Security | AI Services | AWS | Agentic AI | AirflowAccident Coverage | Career growth | Group term life insurance | Health insurance | Hybrid work supportSenior-level Full TimeIQEQ Hyderabad, Tower 2, 7th floor, … R18h ago
-
AIML Engineer Digital & AI INR 3242K-5000KAWS | Azure | CI/CD | Deep learning | DockerAccident Coverage | Career growth | Group term life insurance | Internet allowance | Medical insuranceSenior-level Full TimeIQEQ Hyderabad, Tower 2, 7th floor, … R18h ago
-
Lead Database Engineer INR 1500K-3000KAudit Logging | Azure Data | Azure Data Factory | Azure Database | Azure Database MigrationSenior-level Full TimePune City, India18h ago
-
ETL,K8, NiFi, Kafka, Prod Support/Senior Consultant Specialist INR 2800K-4200KAIOps | AWS | Agile | Ansible | AzureFlexible working | Professional development opportunitiesSenior-level Full TimeHyderabad, Telangana, India R18h ago
-
Data Scientist INR 2500K-4500KAdvanced Statistics | Apache Spark | Azure Data | Azure Data Factory | Azure KubernetesEquity and inclusion focus | Mentorship opportunities | Travel to other locations in India and globally | Work on global projectsSenior-level Full TimeBangalore - Karnataka - India19h ago
-
Lead AI Engineer - Agentic Engineering INR 2500K-5000KAPI Design | Agent Orchestration | Agent systems | Autogen | Automated RegressionSenior-level Full TimeHyderabad, TS, India19h ago
-
MongoDB, Python, MSA/Consultant Specialist INR 1200K-2000KAWS | Aggregation Pipeline | Azure | CI/CD | Data ModelingContinuous professional development | Flexible working | Inclusive workplace cultureSenior-level Full TimeHyderabad, Telangana, India R19h ago
-
Senior-level Full Timebengaluru, India19h ago
-
Senior-level Full Timebengaluru, India19h ago
-
Senior-level Full Timebengaluru, India19h ago
-
Senior-level Full Timebengaluru, India19h ago
-
Sr.Data Engineering INR 1500K-2500KAzure Data | Azure Data Factory | Azure Databricks | Azure Event | Azure Event HubsSenior-level Full Timebengaluru, India19h ago
-
DevOps/MLOps Specialist INR 4000K-5500KAnsible | Apache Airflow | Apache Beam | Apache Kafka | CI/CDMid-level Full Timebengaluru, India19h ago
-
Senior-level Full TimePune, Maharashtra, India20h ago
-
Data Ingestion Engineer (ADF+Dbt+Snowflake) INR 1500K-2000KAPI Integration | Azure Data | Azure Data Factory | DBT | Data FactoryMid-level Full TimePune, MH, India20h ago
-
Lead Developer (Python, React, AWS, GenAI) INR 3242K-4800KAgile | Amazon Web Services | Apache Kafka | Continuous integration | DevSecOpsAutonomy | Inclusive & Supportive Culture | Mentoring | Professional development opportunitiesSenior-level Full TimePune, India20h ago
-
Mid-level Full TimeBengaluru, Karnataka, India R21h ago
-
C# | C++ | Data Science | Data Structures | Distributed SystemsExecutive-level Full TimeBengaluru, Karnataka, India21h ago
-
Senior-level Full TimePune, Maharashtra, India21h ago
-
Assistant Manager INR 1500K-2500KAirflow | BigQuery | Cloud Composer | Cloud Dataproc | Cloud StorageMid-level Full TimePune, Maharashtra, India21h ago
-
Mid-level Full TimeChennai, Tamil Nadu, India R21h ago
-
Applied AI/ML Engineer INR 2000K-3000KAgentic Systems | Bias Mitigation | Decision Trees | Evaluation Frameworks | Fallback mechanismsMid-level Full TimeBengaluru, Karnataka, India21h ago
-
Mid-level Full TimeNoida, Uttar Pradesh, India R21h ago