Data Engineering Lead
IN025 Embassy Manyata Business Park, India
INR 2500K-3380K (estimate) Senior-level Full Time
Tasks
- Apply DevOps DataOps and Agile
- Build data lakes warehouses and analytical systems on Azure
- Deploy data pipelines to production
- Design data pipelines
- Develop data integration tools
- Implement data security with RBAC and Key Vault
- Lead data engineering team
- Manage data governance
- Manage version control and CI/CD pipelines
- Optimize pipeline performance and cost
- Provide Azure subject matter expertise
- Research data engineering methodologies
- Set up monitoring and alerting
- Support data validation activities
- Test pipeline reliability and performance
- Triage production incidents
Perks/Benefits
Skills/Tech-stack
Azure Data | Azure Data Factory | Azure Data Lake | Azure Databricks | Azure DevOps | Azure Key Vault | Azure SQL | Azure Synapse | Azure Synapse Analytics | Bitbucket | CI/CD | Cost Optimization | Data Architecture | Data Factory | Data Governance | Data Lake | Data Modeling | Data Pipeline Monitoring | Data pipeline | DataOps | DevOps | Git | Jenkins | Key Vault | Observability | Pipeline monitoring | PostgreSQL | PySpark | RBAC | Row Level Security | SQL | Spark SQL | Synapse Analytics | TSQL
Roles
Data Engineering | Data Engineering Lead | Engineering Lead | Lead
Related jobs
-
Data Engineer Manager INR 1500K-2000KAPI Development | API Integration | API Publishing | AWS | Apache SparkHybrid workMid-level Full TimeBengaluru, INDIA, India6h ago
-
Tech Lead .Net & React full stack – AI Enablement INR 2500K-4500K.NET | C# | CI/CD | Context window | Contract testingSenior-level Full TimeHyderabad, India6h ago
-
Manager INR 500K-1200KData Management | Data Mapping | Data Migration | Data Privacy | Data QualityMid-level Full TimeGurugram, Haryana, India7h ago
-
Lead Software Engineer – Python, ETL, GLUE, Spark, AWS. INR 2000K-2200KAWS CDK | AWS CloudWatch | AWS Glue | AWS IAM | AWS KMSSenior-level Full TimeBengaluru, Karnataka, India8h ago
-
Azure Lead Data Engineer INR 1200K-2000KAzure | Azure Data | Azure Data Factory | Azure Data Lake | Azure FunctionsSenior-level Full TimeBengaluru, Karnataka, India11h ago
-
Sr Agentic Data Management Advisor INR 1200K-2000KAWS Glue | Advanced SQL | Agentic development | Agentic development tools | AngularSenior-level Full TimeIndia15h ago
-
Mid-level Full TimeIndia - Bangalore18h ago
-
IN_Manager_AWS Architect_D&A_Advisory_PAN India INR 2000K-2200KAWS Cloud | AWS Cloud Architecture | AWS Cost Optimization | AWS Security | AWS complianceFlexibility programmes | Inclusive benefits | Mentorship | Wellbeing supportSenior-level Full TimeBengaluru Millenia, India18h ago
-
IN_Manager_AWS Architect_D&A_Advisory_PAN India INR 2000K-2200KAWS Cloud | AWS Cloud Architecture | AWS Security | AWS Well Architected | AWS Well-Architected FrameworkSenior-level Full TimeBengaluru Millenia, India18h ago
-
Amazon Redshift | Amazon Web Services | Apache Airflow | Apache Kafka | Apache SparkMid-level Full TimeIndia - Bangalore18h ago
-
Director, Data Pipeline Engineering INR 1500K-6000KAWS | Agile | Airflow | Apache Kafka | Apache SparkFlexible time off | Healthcare benefits | Hybrid work model | Retirement plan | Support for working parentsExecutive-level Full TimeM11 - Commers III, 43, 44 …18h ago
-
AI-Ready Data Engineering Team Lead INR 1800K-2647KAI Data | AI data preparation | Amazon Web Services | Cloud Computing | Cloud platformHealth and wellbeing benefits | International work environment | Parental leave | Professional development opportunitiesSenior-level Full TimeHyderabad, India18h ago
-
Deputy Manager-Data Engineering INR 1500K-2500KApache Spark | Azure Data | Azure Data Factory | Azure Data Lake | Azure DatabricksMid-level Full TimeNoida, UP, India1d ago
-
Lead Data Scientist INR 2516K-3500KA/B | A/B Testing | AWS SageMaker | B testing | Collaborative FilteringSenior-level Full TimeBengaluru, Karnataka, India1d ago
-
TechOps - DE - Automation - AI - Manager INR 1500K-2000KAWS | Asyncio | Authentication | Azure | CI/CDCoaching and Mentorship | Continuous learning | Inclusive cultureMid-level Full TimeBengaluru, KA, IN, 5600162d ago
-
AWS Lambda | Amazon Redshift | Amazon S3 | Apache Airflow | Apache HiveCareer Development Programs | Flexible work schedule | In-office collaborationMid-level Full TimeIndia - Bangalore2d ago
-
Mid-level Full TimeIndia - Bangalore2d ago
-
Lead Consultant - RAG Engineer INR 2535K-4225KAWS | AWS Step Functions | Airflow | Amazon SageMaker | Cloud NativeContinuous learning opportunities | Hands-on experience | MentorshipSenior-level Full TimeIndia-Gurugram3d ago
-
Senior-level Full TimeIN-AP-Hyderabad3d ago
-
Senior-level Full TimeBengaluru, Karnataka, India3d ago
-
Consultant _ADF INR 2000K-2000KADF Mapping Data Flows | ARM Templates | Agile | Azure Data | Azure Data FactorySenior-level Full TimeBangalore, Karnataka, India3d ago
-
.NET | AI Foundry | Agile | Azure | Azure AICharitable events and volunteering | Coaching and mentoring | Employee affinity groups | Training and developmentEntry-level Full TimeGurugram, INDIA, India3d ago
-
Lead Data Engineer INR 1200K-2000KAzure | Azure Blob | Azure Blob Storage | Azure Data | Azure Data FactoryUK shift workSenior-level Full TimeBengaluru, KA, India3d ago
-
Analytics Lead - Innovation Practice INR 2516K-3356KApplied statistics | Automation | Cloud Data | Cloud Data Environments | Data AnalysisSenior-level Full TimeBangalore, Karnataka, India; Pune, Maharashtra, India3d ago
-
Senior-level Full TimeNoida3d ago