Module Lead - Azure Job
Tasks
- Create and run data pipeline tests
- Deploy and manage infrastructure with Terraform and Bicep
- Design SQL data models
- Develop Azure Data Factory pipelines
- Develop Python ETL and data processing code
- Document code and components
- Implement CI/CD deployment automation
- Implement Databricks workflows and jobs
- Lead Azure data engineering delivery
- Maintain Git based version control
- Optimize Spark and SQL performance
- Validate data quality
Perks/Benefits
Skills/Tech-stack
Advanced PySpark | Argo Workflows | Asset bundles | Azure Data | Azure Data Factory | Azure DevOps | Azure DevOps Pipelines | Bicep | CI/CD | Data Catalog | Data Factory | Data Governance | Data Lineage | Databricks | Databricks (asset) | Databricks Asset Bundles | Databricks Workflows | Delta Lake | DevOps Pipelines | Docker | Git | Integration Testing | Kubernetes | Power BI | Prompt engineering | Python | Spark SQL | Terraform | Unit Testing | Unity Catalog
Education
N/A
Roles
Data Engineering | Data Engineering Lead | Engineering Lead | Lead
Related jobs
-
Director, Data Architecture/Engineering INR 3600K-5000KAPI Integration | Agile | Automated testing | CI/CD | Container OrchestrationComprehensive healthcare | Flexible time off | Hybrid work model | Retirement plan | Tuition reimbursementSenior-level Full TimeM11 - Commers III, 43, 44 … R16h ago
-
Technical Lead - AI Specialist / Automation Engineer INR 2000K-4800KAdobe | Anthropic | Figma | Fine Tuning | GitHubFull time employment authorized to work without visa sponsorship | Global career opportunities | Robust benefits packageSenior-level Full TimeNoida Office, India20h ago
-
Mid-level Full TimeHyderabad, TS, India1d ago
-
Senior-level Full TimeHyderabad, TS, India1d ago
-
Delivery Lead - AI Engineer INR 4000K-5500KAWS | Apache Spark | Automation | Azure | Cloud platformSenior-level Full TimePune, Maharashtra, India1d ago
-
Airflow | Apache Beam | Apache Flink | Asynchronous Messaging | BigQueryMid-level Full TimePune, Maharashtra, India1d ago
-
Airflow | Apache Beam | Apache Flink | BigQuery | CI/CDMid-level Full TimePune, Maharashtra, India1d ago
-
API Design | Airflow | Alerting | Apache Beam | Apache FlinkMid-level Full TimePune, Maharashtra, India1d ago
-
Airflow | Apache Beam | Apache Flink | BigQuery | CI/CDMid-level Full TimePune, Maharashtra, India1d ago
-
Lead Engineer-Embedded Software Security INR 1600K-4500KAuthentication | Authorization | Black-Duck | C# | C++Senior-level Full TimeBengaluru, India1d ago
-
D&T Lead - Data Science INR 3000K-5000KAgentic AI | AlloyDB | Apache Airflow | Artificial Intelligence | CI/CDSenior-level Full TimePune, IN1d ago
-
Manager Data Integration INR 2520K-4064KApache Airflow | BigQuery | Bigtable | Celigo | Cloud ComposerSenior-level Full TimeBengaluru, KA, India1d ago
-
Embedded Business Analyst, Program Lead INR 2817K-4200KAgile | Artificial Intelligence | Azure | Azure Cloud | BacklogSenior-level Full TimeIN-Bangalore (3811)1d ago
-
Amazon Web Services | Angular | Apache Airflow | Apache Hadoop | AzureSenior-level Full TimeBengaluru Millenia, India1d ago
-
Lead Engineer (Embedded Platform Software) INR 1753K-3000KARM | Board Support | Board Support Package | Bootloader | C#Car lease programme | Contingency leave | Employee scholar programme | Group health insurance | Group personal accident insuranceSenior-level Full TimeIN-KA-BENGALURU-NORTHGATE ~ Sy No 2/2 Venkatala …1d ago
-
Lead Analyst - Global Procurement Analytics and Performance INR 2771K-4000KAriba | Coupa | DAX | Data Governance | Data ModelingCollaborative work environment | Inclusive culture | Professional development opportunitiesSenior-level Full TimeSupport Office India1d ago
-
Senior Data Engineer-1 INR 3000K-4000KAzure Data | Azure Data Factory | Azure Portal | Azure SQL | Azure SQL DatabaseSenior-level Full TimeBangalore - India1d ago
-
Lead AI Engineer INR 2000K-5000KAWS | Agentic Workflows | Apache Spark | Autogen | AzureGrowth opportunities | Hybrid work option | MentorshipSenior-level Full TimeDGS India - Pune - Kharadi …1d ago
-
Software Engineering Lead Analyst - HIH - Evernorth INR 2700K-4000KAWS | Apache Spark | Artifactory | CI/CD | ConfluenceSenior-level Full TimeHIH - Hyderabad, India1d ago
-
Tech Lead - Data INR 1600K-2500KAWS | Access Control | Alerting | Analytics | Batch ProcessingEmployee assistance programme | Flexible schedule | Health insurance | Holiday purchase scheme | Parental leaveSenior-level Full TimeBuilding No 12D, Floor 5, Raheja …1d ago
-
Data Reporting & Visualisation Lead INR 2000K-3500KAcceptance Testing | DAX | Dashboard Design | Data Modeling | Data QASenior-level Full TimeDGS India - Bengaluru - Manyata …1d ago
-
Data Engineering Consultant INR 3000K-3880KAzure | Azure Data | Azure Data Factory | Azure Databricks | Azure SQLSenior-level Full TimePrimary location: Noida, India1d ago
-
Data Engineering Operations Lead INR 3000K-4000KApache Airflow | Apache Hive | Apache Spark | Batch Processing | CI/CDContributory pension | Diversity forums | Hybrid work | Mindfulness app access | Networking groupsSenior-level Full TimePune, India R1d ago
-
Senior-level Full TimeIND - Bengaluru - Brigade Twin …1d ago
-
Lead Data Engineer- Vice President - Data Engineering INR 3000K-4200KAI/ML | Agile | Apache Airflow | Automated testing | CI/CDSenior-level Full TimeCOMMERZ III, OBEROI GARDEN CITY, India1d ago