Lead Data Engineer
Bangalore, KA, IN, 560076
INR 2520K-3380K (estimate) Senior-level Full Time
Tasks
- Build CI CD pipelines for data jobs
- Collaborate with data scientists and stakeholders
- Coordinate development across software development life cycle
- Design and evaluate data models
- Design data lakes and data pipelines
- Design data warehouses and data marts
- Develop end-to-end data workflows
- Implement delta lake architecture
- Integrate and transform large scale data
- Maintain code repositories and version control
- Monitor and troubleshoot Spark jobs and ETL processes
- Optimize data storage and query performance
Perks/Benefits
- Community outreach programs
- Employee Resource Group
- Employee stock purchase program
- Health and wellness incentives
Skills/Tech-stack
AWS | AWS CloudFormation | AWS DMS | AWS Glue | AWS Lake Formation | Amazon EMR | Amazon Kinesis | Amazon RDS | Amazon Redshift | Amazon S3 | Apache Hudi | Apache Spark | CI/CD | Data Modeling | Databricks | Databricks Delta | Databricks Notebooks | Delta Lake | Delta Live Tables | Delta Live) | ETL | Git | Infrastructure as Code | Lake Formation | MLflow | PySpark | Python | SQL | Snowflake | Snowflake Schema | Star Schema | Terraform | Unity Catalog | “as-code”
Education
N/A
Roles
Data Engineer | Engineer | Lead | Lead Data | Lead Data Engineer
Related jobs
-
Data Engineer INR 2800K-4000KCloud Databases | Data Modeling | Data Normalization | Data Quality | Data WarehousingOnshore Offshore modelSenior-level Full TimeMumbai, MH, India17h ago
-
Software Engineer - AI/ML INR 2500K-4500KAPI Development | Agent-based | Agent-based systems | Anthropic API | C#Senior-level Full TimeBengaluru, KA, India20h ago
-
Data Engineering Lead INR 3000K-4000KAmazon Web Services | Artificial Intelligence | Data Governance | Data Pipelines | Data platformAnnual bonus | Health insurance | Knowledge sharing | Learning and development | PensionSenior-level Full TimeRemote, Bangalore R20h ago
-
Mid-level Full TimePune, MAHĀRĀSHTRA, India21h ago
-
Senior Data Engineer (Databricks) (Remote) INR 1500K-2040KAI | API Keys | AWS Glue | AWS IAM | AWS LambdaCollaboration | Ownership culture | Remote workSenior-level Full TimeMaharashtra, Pune, India R21h ago
-
Analytics Engineer INR 2755K-4000KAWS | Alteryx | Apache Airflow | Azure | Azure DataDiscounted gym membership | Flexible working | Life assurance | Medical insurance | Pension schemeSenior-level Full TimeHyderabad, Telangana, India22h ago
-
AI / ML Engineer (Remote) INR 2500K-4500KAWS | Amazon SageMaker | CI/CD | Computer Vision | Data PreprocessingRemote workSenior-level Full TimeMaharashtra, Pune, India R22h ago
-
Fullstack Data Engineer (India) INR 1500K-2300KAPI Keys | AWS Glue | AWS IAM | AWS Lambda | AWS S3Remote work | UK shift hoursSenior-level Full TimeMaharashtra, Pune, India22h ago
-
Principal Consultant, Cloud Data Engineer INR 2800K-4000KApache Spark | Azure | Big Data | CI/CD | Data ModelingAI certifications | Mentorship | World-class trainingSenior-level Full TimeIndia-Bangalore22h ago
-
Data Engineer INR 1500K-2000KAgentic AI | Cloud Computing | Cost Optimization | Data Architecture | Data PipelinesMid-level Full TimeIN-MH-Pune22h ago
-
Big Data -Snowflake INR 1200K-2000KBig Data | Data Engineering | Data Modeling | Data Pipelines | Data QualitySenior-level Full TimeIN-TN-Chennai22h ago
-
Electrical Engineer with Computational Skill - "High-rise & Complex Buildings" - Chennai / Noida INR 1400K-1854KAMTECH | AutoCAD | Autodesk Revit | BIM | BIM automationContinuing professional developmentSenior-level Full TimeChennai, India23h ago
-
DE&A - AIML - Project Management INR 3000K-4000KArtificial Intelligence | Azure | Cloud Computing | Cloud platform | Data EngineeringSenior-level Full TimeHyderabad, Telangana, India23h ago
-
Senior-level Full TimePune, Maharashtra, India1d ago
-
Machine Learning Design Engineer, Silicon INR 3400K-5000KASIC design | Area Optimization | Assertion-based Formal Verification | CHISEL | CacheSenior-level Full TimeBengaluru, Karnataka, India1d ago
-
Analytics Lead, Large Customer Sales INR 1000K-2500KAdvanced Analytics | Attribution Modeling | Dashboard automation | Data Analysis | Data Signal ImplementationSenior-level Full TimeGurugram, Haryana, India1d ago
-
Senior-level Full TimePune, India1d ago
-
Analytics Solutions Manager INR 1234K-1748KAccess Control | Anomaly Detection | Artificial Intelligence | CDC | CI/CDMid-level Full TimeBengaluru, Karnataka, India1d ago
-
Software Engineer II INR 1400K-1700KAPI Development | Apache Spark | Azure | Azure Cosmos | Azure Cosmos DBMid-level Full TimeBengaluru, KA, IN1d ago
-
Associate - Data Scientist INR 1800K-2500KAWS | Agent systems | Apache Spark | Azure | Cloud platformMid-level Full TimeNoida, Uttar Pradesh, India1d ago
-
Senior Data Engineer INR 2800K-3500KAPI Development | AWS | Algorithms | Amazon Kinesis | Amazon RedshiftCharity programs | Discounted gym memberships | Environmental initiatives | Flexible working | Life assuranceSenior-level Full TimeHyderabad, India1d ago
-
Lead Assistant Manager INR 1500K-2000KAWS | Apache Airflow | Azure | Data Governance | Data LakehouseSenior-level Full TimeIndia1d ago
-
Assistant Manager INR 800K-1500KApache Airflow | Data Modeling | Data Processing | Databricks | Distributed dataTraining and developmentSenior-level Full TimeIndia1d ago
-
MET scientist INR 2000K-4000KAPIs | AWS | Artificial Intelligence | Azure | CI/CDBonus system | Canteen | Family-friendly initiatives | Fitness room | Learning and trainingEntry-level Full TimePune, MAHĀRĀSHTRA, India1d ago
-
Lead Data Visulaization INR 2000K-3900KAirflow | Amazon Redshift | Azure Data | Azure Data Factory | Azure SynapseSenior-level Full TimeTamil Nadu, Chennai, India1d ago