Lead Data Engineer
IN025 Embassy Manyata Business Park, India
INR 2400K-3500K (estimate) Senior-level Full Time
Tasks
- Build and manage data lakes warehouses and analytical systems
- Build proof-of-concepts
- Deploy data pipelines to production
- Design and develop data pipelines
- Implement automation observability and monitoring
- Implement security and data governance
- Lead data engineering team
- Manage version control and CI/CD pipelines
- Monitor performance and stability
- Optimize data pipeline cost and performance
- Perform data validation
- Set up alerting and runbooks
- Support end to end data architectures
- Test pipeline reliability and performance
- Triage incidents and adapt pipelines
Perks/Benefits
Skills/Tech-stack
Agile | Azure | Azure Data | Azure Data Factory | Azure Data Lake | Azure Databricks | Azure DevOps | Azure Key Vault | Azure SQL | Azure Synapse | Azure Synapse Analytics | Bitbucket | CI/CD | Column-Level Security | Data Factory | Data Governance | Data Lake | Data Modeling | DataOps | DevOps | Git | Jenkins | Key Vault | OLS | Performance Tuning | PySpark | RBAC | RLS | Row Level Security | SQL | Spark SQL | Stored Procedures | Synapse Analytics | T-SQL
Education
Bachelor of Engineering | Bachelor of Science | Bachelor of Science in Computer Science | Bachelor of Science in Data Analytics | Bachelor of Science in Information Technology
Roles
Data Engineer | Engineer | Lead | Lead Data | Lead Data Engineer
Related jobs
-
Mid-level Full TimeHaryana, Gurugram, India16h ago
-
People Analytics & Workforce Intelligence Lead INR 2400K-3380KArtificial Intelligence | Automation | BI Publisher | Dashboarding | Data GovernanceAgile working opportunities | Birthday off | Flexible working hoursSenior-level Full TimeGurgaon19h ago
-
Senior Embedded Software Development Engineer INR 2156K-3200KAgile | C# | CI/CD | CppUnit | EmulatorsAnnual bonus | Flexible hours | Health insurance | On-demand training | Paid volunteering leaveSenior-level Full TimeChennai, TN, IN, 60009722h ago
-
Data Engineer II INR 1500K-2000KApache Spark | Azure Data | Azure Data Explorer | Azure Data Factory | Azure SynapseMid-level Full TimeHyderabad, TS, IN1d ago
-
Databricks Engineer/ Architect INR 1500K-2000KAWS | Apache Spark | Azure | Cloud platform | Data GovernanceSenior-level Contract Full TimeIndia - Remote R1d ago
-
Principal Engineer - Analytics INR 2000K-3500KAgile | Cassandra | Continuous integration | Data Visualization | HadoopSenior-level Full TimeMumbai, Maharashtra, India1d ago
-
Entry-level Full TimeMumbai, Maharashtra, India1d ago
-
AWS | Agent systems | Agentic AI | Amazon SageMaker | Autonomous AgentsSenior-level Full TimeBengaluru Millenia, India1d ago
-
Azure Databricks | CI/CD | Data Pipelines | Data integration | ETLSenior-level Full TimeGurugram 10 C, India1d ago
-
Azure Databricks | Data integration | ETL | Filtering | JoiningSenior-level Full TimeGurugram 10 C, India1d ago
-
IN_Associate_Python/Gen AI_AI in Delivery_Advisory_Bangalore INR 3000K-4000KAWS | Azure | CI/CD | Data Augmentation | Data PreprocessingFlexibility programmes | Inclusive benefits | Mentorship | Wellbeing supportSenior-level Full TimeBengaluru Millenia, India1d ago
-
IN_Associate_Python/Gen AI_AI in Delivery_Advisory_Bangalore INR 3000K-4000KAWS | Adversarial Networks | Autoregressive models | CI/CD | Cloud platformFlexible work arrangements | Inclusive benefits | Mentorship | Wellbeing supportSenior-level Full TimeBengaluru Millenia, India1d ago
-
IN_Associate_Python/Gen AI_AI in Delivery_Advisory_Bangalore INR 3000K-4000KAWS | Adversarial Networks | Autoregressive models | Azure | CI/CDFlexibility program | Inclusive benefits | Mentorship | Wellbeing supportSenior-level Full TimeBengaluru Millenia, India1d ago
-
Module Lead - GCP Data Engineer Job INR 1650K-3200KBigQuery | Bigtable | CI/CD | Cloud Build | Cloud NetworkingContinuous learning | Flexible work arrangements | Stable employmentSenior-level Full TimeHyderabad, TG, IN1d ago
-
Senior Principal Engineer - Data Engineering INR 3000K-4000KAWS | Apache Spark | Automation | Azure Data | Azure Data FactoryHybrid work environment | Inclusive culture | Professional development opportunities | Supportive leadersSenior-level Full TimePune - Panchshil, India R1d ago
-
Senior Data Engineer INR 3000K-4000KApache Spark | Azure Data | Azure Data Factory | Azure Data Lake | Azure Machine LearningSenior-level Full TimeIT Centre Bengaluru GDTC, India1d ago
-
API Development | Async Programming | Autogen | CI/CD | CrewAISenior-level Full TimeBengaluru Millenia, India1d ago
-
Lead AI Designer– Agentic AI (L6) INR 2000K-3500KAPIs | AWS | Agent SDK | Asynchronous programming | AutogenSenior-level Full TimePune, India1d ago
-
Senior Data Engineer INR 3000K-4000KAgile | Analysis Services | Azure Analysis | Azure Analysis Services | Azure DataSenior-level Full TimeIT Centre Bengaluru GDTC, India1d ago
-
Associate, Data Engineer INR 1400K-2700KApache Airflow | Azure Blob | Azure Blob Storage | Azure Event | Azure Event GridComprehensive healthcare | Flexible time off | Flexible-hybrid work | Tuition reimbursementMid-level Full TimeM11 - Commers III, 43, 44 … R1d ago
-
Agent systems | Agentic AI | Amazon SageMaker | Autonomous Agents | Azure Machine LearningFlexibility programs | Inclusive benefits | Mentorship | Wellbeing supportSenior-level Full TimeBengaluru Millenia, India1d ago
-
A/B | A/B Testing | AWS | Azure | B testingFlexible work arrangements | Hybrid work environment | MentorshipSenior-level Full TimeMumbai Goregaon, India1d ago
-
AWS SageMaker | Agent systems | Autonomous Agents | Azure ML | Computer VisionFlexibility programs | Inclusive benefits | Mentorship | Wellbeing supportSenior-level Full TimeBengaluru Millenia, India1d ago
-
Agile | Data Cleansing | Data Enrichment | Data Governance | Data ManagementFlexibility programmes | Inclusive benefits | MentorshipSenior-level Full TimePune, India1d ago
-
Azure | Azure Databricks | ETL | PySpark | PythonFlexible work arrangements | Inclusive benefits | Mentorship | Wellbeing supportSenior-level Full TimeGurugram 10 C, India1d ago