Module Lead - Azure Job
Tasks
- Create and run data pipeline tests
- Deploy and manage infrastructure with Terraform and Bicep
- Design SQL data models
- Develop Azure Data Factory pipelines
- Develop Python ETL and data processing code
- Document code and components
- Implement CI/CD deployment automation
- Implement Databricks workflows and jobs
- Lead Azure data engineering delivery
- Maintain Git based version control
- Optimize Spark and SQL performance
- Validate data quality
Perks/Benefits
Skills/Tech-stack
Advanced PySpark | Argo Workflows | Asset bundles | Azure Data | Azure Data Factory | Azure DevOps | Azure DevOps Pipelines | Bicep | CI/CD | Data Catalog | Data Factory | Data Governance | Data Lineage | Databricks | Databricks (asset) | Databricks Asset Bundles | Databricks Workflows | Delta Lake | DevOps Pipelines | Docker | Git | Integration Testing | Kubernetes | Power BI | Prompt engineering | Python | Spark SQL | Terraform | Unit Testing | Unity Catalog
Education
N/A
Roles
Data Engineering | Data Engineering Lead | Engineering Lead | Lead
Related jobs
-
Adstock | ArviZ | Bayesian Modeling | Bayesian Models | Causal InferenceSenior-level Full TimeHyderabad, TS, India10h ago
-
A/B | A/B Testing | Anomaly Detection | Auditability | B testingSenior-level Full TimePune, MH, India13h ago
-
Head of Data & Analytics INR 1500K-6000KAI | API Integration | Azure Data | Azure Data Factory | Azure SynapseExecutive-level Full TimeNoida, Uttar Pradesh, India15h ago
-
EY - GDS Consulting - AI And DATA - Snowflake plus AWS - Manager INR 1500K-2600KAI Engineering | API Integration | AWS Data | AWS Data Engineering | Amazon AthenaClient impact | Flexible Work N/A | Global career support | Inclusive culture | MentoringMid-level Full TimeKolkata, WB, IN, 70009120h ago
-
Lead Data & AI Scientist INR 3000K-5000KAsyncio | Cloud platform | Debugging | Ensemble Methods | ForecastingFlexible working | Hybrid workingSenior-level Full TimeHyderabad Knowledge Park Tower 2, India20h ago
-
Lead Data Engineer, ITC INR 1500K-3000KAWS DynamoDB | AWS Lambda | AWS Step Functions | Amazon Elasticsearch | Amazon Elasticsearch ServiceSenior-level Full TimeINDIA TECHNOLOGY CENTER, India20h ago
-
Statistical Programming Team Lead INR 3000K-4000KClinical data | Clinical data management | Data Management | Data Validation | ICH GCPEmployee Assistance programmes | Learning and development opportunities | Life assurance and disability coverage | Medical, dental, and vision coverage | Retirement and pension plansSenior-level Full TimeIndia, Bangalore20h ago
-
Senior-level Full TimeIN Hyderabad, India20h ago
-
Test Lead - Data Automation INR 1500K-2500KCase design | ETL | Manual Testing | Python | Regression testingSenior-level Full TimeIndia2d ago
-
Lead Data Engineer INR 2771K-4064KAWS | Cloud Computing | Data Governance | Data Processing | Data StreamingSenior-level Full TimeBengaluru, Karnataka, India3d ago
-
Analyst- Data Engineering INR 800K-1500KData Analysis | Financial Data | Financial Data Analysis | Git | JiraMid-level Full TimeBangalore, Karnataka, India R3d ago
-
Senior-level Full TimeBengaluru, India3d ago
-
AWS | AWS Kinesis | Agile | Apache Kafka | Cloud platformCloud certification support | Collaborative innovation environment | Inclusive diverse workplace | Mentoring and thought leadership opportunities | Professional developmentSenior-level Full TimeIndia3d ago
-
Enterprise Data Lead INR 3000K-4000KAPI | Anaplan | Automation | Boomi | Data CleansingAnnual leave | Development programmes | Employee assistance programme | Life insurance | Online learning platformSenior-level Full TimeBengaluru, KA, India R3d ago
-
Enterprise Data Lead INR 3000K-4064KAPI | Boomi | Data Cleansing | Data Deduplication | Data GovernanceAnnual leave | Employee assistance programme | Life insurance | Online learning platform | Performance bonusSenior-level Full TimeBengaluru, KA, India R3d ago
-
Lead Data Scientist INR 3000K-4200KAWS | Amazon Redshift | Azure | Decision Science | Discrete choiceAnnual leave | Employer pension contribution | Flexible benefits | Health cash plan | Income protectionSenior-level Full TimeHyderabad, International Tech Park, India3d ago
-
Senior Manager - Data Engineer- Methodology & Assumption (M&A) Actuarial Policyholder Data Team INR 2817K-4064KApache Spark | Azure Databricks | Data Governance | Data Modeling | Data PipelinesSenior-level Full TimeMumbai Central Avenue, India3d ago
-
Senior-level Full TimeBangalore, In, India3d ago
-
Senior-level Full TimeChennai, India3d ago
-
SAP Master Data Governance Lead INR 2000K-3900KCutover planning | Data Governance | Data Migration | Data Modeling | Data QualityDisability inclusion accommodations | Flexible working options when possible | Opportunities to grow | Supportive team collaborationSenior-level Full TimePune, India3d ago
-
Lead Software Engineer INR 2771K-4000KAWS | Agile | Airflow | Apache Beam | AzureGuided career tracks | Healthcare benefits | Hybrid work | Online learning platform | Organizational growth potentialSenior-level Full TimeIND-Pune-Equifax Analytics-PEC, India3d ago
-
Director, AI Engineering Tech Lead INR 4000K-5200KAI Foundry | AWS | Artificial Intelligence | Automated testing | AzureEqual opportunity employer | Hybrid work environmentSenior-level Full TimeIND - Mumbai, India3d ago
-
Senior-level Full TimeIND Bengaluru, India3d ago
-
Data & Recon Division Lead INR 2000K-3500KData Privacy | Data Security | Jira | Microsoft Office | Project ManagementSenior-level Full TimeOffice - Noida, India3d ago
-
Lead Data Scientist, Growth Marketing INR 3150K-4500KAdobe Analytics | Bayesian statistics | CUPED | Causal Inference | ClusteringSenior-level Full TimeIndia - Hyderabad3d ago