Data engineering lead
IND - Bengaluru, India
INR 2520K-3380K (estimate) Senior-level Full Time
Tasks
- Build scalable batch micro batch and streaming data pipelines
- Conduct architecture reviews and code quality governance
- Coordinate with business intelligence data science AI and cloud teams
- Drive data governance and quality controls
- Ensure production data accuracy timeliness reliability
- Implement observability error handling retries checkpointing
- Lead data architecture design
- Manage data engineering team mentoring and roadmap execution
- Optimize Spark distributed computing performance
Perks/Benefits
- Bereavement leave
- Diversity, equity, and inclusion programs
- Employee assistance program
- Employee referral program
- Group accident insurance
- Group term life insurance
- Healthcare insurance
- Home internet reimbursement
- Hybrid work environment
- Learning platforms
- Maternity leave
- Mobile Phone Reimbursement
- Paternity leave
Skills/Tech-stack
AWS Cloud | AWS Cloud Development Kit | AWS CloudFormation | AWS DMS | AWS Lambda | AWS Step Functions | AWS cloud development | Amazon Aurora | Amazon Aurora RDS | Amazon CloudWatch | Amazon EventBridge | Amazon S3 | Apache Spark | Aurora RDS | Cloud Development Kit | Data Governance | Data Lake | Data Lineage | Data Modeling | Data Products | Data Quality | Data Warehouse | Data fabric | Data mesh | Databricks | Delta Lake | Dimensional Modeling | ETL | GitHub | GitHub Actions | GitLab | NoSQL | PySpark | Python | SQL | Spark Structured Streaming | Step Functions | Structured Streaming | Unity Catalog
Education
Bachelor of Computer Science | Bachelor of Engineering | Bachelor of Science | Master of Science
Roles
Data Engineering | Data Engineering Lead | Engineering Lead | Lead
Related jobs
-
Data Engineer Manager INR 1500K-2000KAPI Development | API Integration | API Publishing | AWS | Apache SparkHybrid workMid-level Full TimeBengaluru, INDIA, India19h ago
-
Manager INR 500K-1200KData Management | Data Mapping | Data Migration | Data Privacy | Data QualityMid-level Full TimeGurugram, Haryana, India21h ago
-
Lead Software Engineer – Python, ETL, GLUE, Spark, AWS. INR 2000K-2200KAWS CDK | AWS CloudWatch | AWS Glue | AWS IAM | AWS KMSSenior-level Full TimeBengaluru, Karnataka, India22h ago
-
Azure Lead Data Engineer INR 1200K-2000KAzure | Azure Data | Azure Data Factory | Azure Data Lake | Azure FunctionsSenior-level Full TimeBengaluru, Karnataka, India1d ago
-
Sr Agentic Data Management Advisor INR 1200K-2000KAWS Glue | Advanced SQL | Agentic development | Agentic development tools | AngularSenior-level Full TimeIndia1d ago
-
Mid-level Full TimeIndia - Bangalore1d ago
-
IN_Manager_AWS Architect_D&A_Advisory_PAN India INR 2000K-2200KAWS Cloud | AWS Cloud Architecture | AWS Cost Optimization | AWS Security | AWS complianceFlexibility programmes | Inclusive benefits | Mentorship | Wellbeing supportSenior-level Full TimeBengaluru Millenia, India1d ago
-
IN_Manager_AWS Architect_D&A_Advisory_PAN India INR 2000K-2200KAWS Cloud | AWS Cloud Architecture | AWS Security | AWS Well Architected | AWS Well-Architected FrameworkSenior-level Full TimeBengaluru Millenia, India1d ago
-
Lead Engineer- Computer Vision INR 2500K-4000K3D Vision | Anomaly Detection | Computer Vision | Convolutional Neural Networks | Data PipelinesRelocation assistance providedSenior-level Full TimeBengaluru, India1d ago
-
Amazon Redshift | Amazon Web Services | Apache Airflow | Apache Kafka | Apache SparkMid-level Full TimeIndia - Bangalore1d ago
-
Director, Data Pipeline Engineering INR 1500K-6000KAWS | Agile | Airflow | Apache Kafka | Apache SparkFlexible time off | Healthcare benefits | Hybrid work model | Retirement plan | Support for working parentsExecutive-level Full TimeM11 - Commers III, 43, 44 …1d ago
-
Data Engineering Lead INR 2500K-3380KAzure Data | Azure Data Factory | Azure Data Lake | Azure Databricks | Azure DevOpsHybrid workSenior-level Full TimeIN025 Embassy Manyata Business Park, India1d ago
-
Senior-level Full TimeRMZ Ecoworld 32, India1d ago
-
AI-Ready Data Engineering Team Lead INR 1800K-2647KAI Data | AI data preparation | Amazon Web Services | Cloud Computing | Cloud platformHealth and wellbeing benefits | International work environment | Parental leave | Professional development opportunitiesSenior-level Full TimeHyderabad, India1d ago
-
Corporate Bank Technology – Cash Management – AI Lead - VP INR 2520K-4225KAWS | Agile | Automated testing | Azure | Azure DataAccident insurance | Best in class leave policy | Certification sponsorship | Childcare assistance reimbursement | Employee assistance programSenior-level Full TimeBangalore, Velankani Tech Park, India1d ago
-
Data Engineering Manager - Azure INR 1431K-2000KAgile | Automation | Azure | Azure Data | Azure Data FactoryFlexible work environment | Internal mobility | Volunteering support | Work-life balanceSenior-level Full TimeKA Bangalore, India1d ago
-
Senior Manager, GSF GenAI & Agentic AI Tech Lead INR 2535K-3500KAWS | Agentic AI | Agile | Automated testing | CI/CDFlexible work arrangements | Hybrid work arrangement | Visa sponsorshipSenior-level Full TimeIND - Telangana - Hyderabad (HITEC …1d ago
-
Director: AI Tech Lead INR 2535K-4500KAgile | Apache Spark | Artificial Intelligence | Azure Data | Azure Data ExplorerAccident insurance | Coaching support | Comprehensive hospitalization insurance | Continuous learning culture | Employee assistance programSenior-level Full TimePune - Margarpatta, India1d ago
-
Digital Health Senior Manager, Data Engineering INR 2040K-2500KAWS | Amazon Glue | Amazon QuickSight | Amazon Redshift | Apache AirflowSenior-level Full TimeBangalore - AGS, India1d ago
-
Senior Staff Engineer, Data Architecture INR 2000K-2146KAccess Control | Azure Data | Azure Data Factory | Azure SQL | Bronze Silver GoldHybrid workSenior-level Full TimeHaryana, Gurugram International Techpark, Block I …1d ago
-
IN_Manager_AWS Architect_D&A_Advisory_PAN India INR 2000K-2200KAWS Cloud | AWS Cloud Architecture | AWS Cost Optimization | AWS Security | Apache AirflowSenior-level Full TimeBengaluru Millenia, India1d ago
-
Lead Analytics Consultant INR 1650K-2227KAgentic Analytics | Azure | Cloud Native | Cloud-native development | Code reviewSenior-level Full Time111442-IND-BENGALURU-INTL BLR BLK B3 PETUNIA, India1d ago
-
Lead Analytics Consultant INR 1615K-2273KAnalytics | Cloud Data | Cloud Data Platforms | Data Engineering | Data GovernanceSenior-level Full Time111442-IND-BENGALURU-INTL BLR BLK B3 PETUNIA, India1d ago
-
Lead - Data Engineer INR 1431K-2000KAzure | Azure Data | Azure Data Factory | Azure Databricks | Azure DevOpsGuided career tracks | Healthcare benefits | Hybrid work setting | Online learning platform | Paid time offSenior-level Full TimeIND-Bangalore-Equifax-Analytics, India1d ago
-
Lead Full Stack Engineer INR 2500K-2829KAWS | Agile | Airflow | Angular | Angular MaterialGuided career tracks | Healthcare benefits | Hybrid work | Online learning platform | Paid time offSenior-level Full TimeIND-Pune-Equifax Analytics-PTEC, India1d ago