Data Engineering Lead
INR 2500K-3380K (estimate) Senior-level Full Time
Tasks
- Apply DevOps DataOps and Agile
- Build data lakes warehouses and analytical systems on Azure
- Deploy data pipelines to production
- Design data pipelines
- Develop data integration tools
- Implement data security with RBAC and Key Vault
- Lead data engineering team
- Manage data governance
- Manage version control and CI/CD pipelines
- Optimize pipeline performance and cost
- Provide Azure subject matter expertise
- Research data engineering methodologies
- Set up monitoring and alerting
- Support data validation activities
- Test pipeline reliability and performance
- Triage production incidents
Perks/Benefits
Skills/Tech-stack
Azure Data | Azure Data Factory | Azure Data Lake | Azure Databricks | Azure DevOps | Azure Key Vault | Azure SQL | Azure Synapse | Azure Synapse Analytics | Bitbucket | CI/CD | Cost Optimization | Data Architecture | Data Factory | Data Governance | Data Lake | Data Modeling | Data Pipeline Monitoring | Data pipeline | DataOps | DevOps | Git | Jenkins | Key Vault | Observability | Pipeline monitoring | PostgreSQL | PySpark | RBAC | Row Level Security | SQL | Spark SQL | Synapse Analytics | TSQL
Roles
Data Engineering | Data Engineering Lead | Engineering Lead | Lead
Related jobs
-
Data Engineer Manager INR 1500K-2000KAPI Development | API Integration | API Publishing | AWS | Apache SparkHybrid workMid-level Full TimeBengaluru, INDIA, India7h ago
-
Tech Lead .Net & React full stack – AI Enablement INR 2500K-4500K.NET | C# | CI/CD | Context window | Contract testingSenior-level Full TimeHyderabad, India8h ago
-
Manager INR 500K-1200KData Management | Data Mapping | Data Migration | Data Privacy | Data QualityMid-level Full TimeGurugram, Haryana, India8h ago
-
Lead Software Engineer – Python, ETL, GLUE, Spark, AWS. INR 2000K-2200KAWS CDK | AWS CloudWatch | AWS Glue | AWS IAM | AWS KMSSenior-level Full TimeBengaluru, Karnataka, India10h ago
-
Azure Lead Data Engineer INR 1200K-2000KAzure | Azure Data | Azure Data Factory | Azure Data Lake | Azure FunctionsSenior-level Full TimeBengaluru, Karnataka, India13h ago
-
Sr Agentic Data Management Advisor INR 1200K-2000KAWS Glue | Advanced SQL | Agentic development | Agentic development tools | AngularSenior-level Full TimeIndia16h ago
-
Mid-level Full TimeIndia - Bangalore19h ago
-
IN_Manager_AWS Architect_D&A_Advisory_PAN India INR 2000K-2200KAWS Cloud | AWS Cloud Architecture | AWS Cost Optimization | AWS Security | AWS complianceFlexibility programmes | Inclusive benefits | Mentorship | Wellbeing supportSenior-level Full TimeBengaluru Millenia, India19h ago
-
IN_Manager_AWS Architect_D&A_Advisory_PAN India INR 2000K-2200KAWS Cloud | AWS Cloud Architecture | AWS Security | AWS Well Architected | AWS Well-Architected FrameworkSenior-level Full TimeBengaluru Millenia, India19h ago
-
Amazon Redshift | Amazon Web Services | Apache Airflow | Apache Kafka | Apache SparkMid-level Full TimeIndia - Bangalore19h ago
-
Director, Data Pipeline Engineering INR 1500K-6000KAWS | Agile | Airflow | Apache Kafka | Apache SparkFlexible time off | Healthcare benefits | Hybrid work model | Retirement plan | Support for working parentsExecutive-level Full TimeM11 - Commers III, 43, 44 …19h ago
-
AI-Ready Data Engineering Team Lead INR 1800K-2647KAI Data | AI data preparation | Amazon Web Services | Cloud Computing | Cloud platformHealth and wellbeing benefits | International work environment | Parental leave | Professional development opportunitiesSenior-level Full TimeHyderabad, India19h ago
-
Corporate Bank Technology – Cash Management – AI Lead - VP INR 2520K-4225KAWS | Agile | Automated testing | Azure | Azure DataAccident insurance | Best in class leave policy | Certification sponsorship | Childcare assistance reimbursement | Employee assistance programSenior-level Full TimeBangalore, Velankani Tech Park, India19h ago
-
Data Engineering Manager - Azure INR 1431K-2000KAgile | Automation | Azure | Azure Data | Azure Data FactoryFlexible work environment | Internal mobility | Volunteering support | Work-life balanceSenior-level Full TimeKA Bangalore, India19h ago
-
Senior Manager, GSF GenAI & Agentic AI Tech Lead INR 2535K-3500KAWS | Agentic AI | Agile | Automated testing | CI/CDFlexible work arrangements | Hybrid work arrangement | Visa sponsorshipSenior-level Full TimeIND - Telangana - Hyderabad (HITEC …19h ago
-
Director: AI Tech Lead INR 2535K-4500KAgile | Apache Spark | Artificial Intelligence | Azure Data | Azure Data ExplorerAccident insurance | Coaching support | Comprehensive hospitalization insurance | Continuous learning culture | Employee assistance programSenior-level Full TimePune - Margarpatta, India19h ago
-
Deputy Manager-Data Engineering INR 1500K-2500KApache Spark | Azure Data | Azure Data Factory | Azure Data Lake | Azure DatabricksMid-level Full TimeNoida, UP, India1d ago
-
Lead Data Scientist INR 2516K-3500KA/B | A/B Testing | AWS SageMaker | B testing | Collaborative FilteringSenior-level Full TimeBengaluru, Karnataka, India1d ago
-
TechOps - DE - Automation - AI - Manager INR 1500K-2000KAWS | Asyncio | Authentication | Azure | CI/CDCoaching and Mentorship | Continuous learning | Inclusive cultureMid-level Full TimeBengaluru, KA, IN, 5600162d ago
-
AWS Lambda | Amazon Redshift | Amazon S3 | Apache Airflow | Apache HiveCareer Development Programs | Flexible work schedule | In-office collaborationMid-level Full TimeIndia - Bangalore2d ago
-
Mid-level Full TimeIndia - Bangalore2d ago
-
Lead Consultant - RAG Engineer INR 2535K-4225KAWS | AWS Step Functions | Airflow | Amazon SageMaker | Cloud NativeContinuous learning opportunities | Hands-on experience | MentorshipSenior-level Full TimeIndia-Gurugram3d ago
-
Senior-level Full TimeIN-AP-Hyderabad3d ago
-
Senior-level Full TimeBengaluru, Karnataka, India3d ago
-
Consultant _ADF INR 2000K-2000KADF Mapping Data Flows | ARM Templates | Agile | Azure Data | Azure Data FactorySenior-level Full TimeBangalore, Karnataka, India3d ago