Module Lead - Azure Job
Tasks
- Create and run data pipeline tests
- Deploy and manage infrastructure with Terraform and Bicep
- Design SQL data models
- Develop Azure Data Factory pipelines
- Develop Python ETL and data processing code
- Document code and components
- Implement CI/CD deployment automation
- Implement Databricks workflows and jobs
- Lead Azure data engineering delivery
- Maintain Git based version control
- Optimize Spark and SQL performance
- Validate data quality
Perks/Benefits
Skills/Tech-stack
Advanced PySpark | Argo Workflows | Asset bundles | Azure Data | Azure Data Factory | Azure DevOps | Azure DevOps Pipelines | Bicep | CI/CD | Data Catalog | Data Factory | Data Governance | Data Lineage | Databricks | Databricks (asset) | Databricks Asset Bundles | Databricks Workflows | Delta Lake | DevOps Pipelines | Docker | Git | Integration Testing | Kubernetes | Power BI | Prompt engineering | Python | Spark SQL | Terraform | Unit Testing | Unity Catalog
Education
N/A
Roles
Data Engineering | Data Engineering Lead | Engineering Lead | Lead
Related jobs
-
API Design | AWS | Agent systems | Autogen | AzureCross-functional collaboration | Full-time employment | Fully remote | Mentorship opportunities | Remote from IndiaSenior-level Full TimeIndia R8h ago
-
AI Engineering Lead - Agentic Engineering INR 2500K-5000KAPI Design | APIs | Agent Orchestration | Agent systems | AutogenSenior-level Full TimeHyderabad, TS, India18h ago
-
Data Engineering Manager - GCP INR 1500K-2500KAirflow | Apache Spark | BigQuery | CI/CD | Cloud ComposerSenior-level Full TimeHyderabad, TS, India2d ago
-
DATA Architect - Lead Systems Engineer INR 2771K-4132KAgile | Apache Airflow | Apache Kafka | Apache Spark | Audit LoggingSenior-level Full TimeIndia2d ago
-
Lead Salesforce Full Stack AI Engineer INR 3715K-5449KAPI Design | Agile | Apex | Automated testing | Azure DevOpsFlexible schedule | Generous vacation days | Health coverage | Parental leave | Volunteer timeSenior-level Full TimeBangalore, India2d ago
-
AWS Glue | AWS Lambda | AWS Step Functions | Amazon EC2 | Amazon EMRSenior-level Full TimeNoida, India2d ago
-
Specialist - Data Engineering-Data Analysis INR 1000K-1700KAWS Redshift | Automation | Data Warehousing | ETL | GitMid-level Full TimeNoida, Uttar Pradesh, India3d ago
-
AI/ML Engineering Lead/(Gen AI,Python,LLM,ETL)Associate Director INR 2000K-4000KAccess Management | Apache Airflow | Apache Beam | Audit Logging | Automated testingMid-level Full TimePune, Maharashtra, India R3d ago
-
Lead Software Engineer - Java AWS Kafka INR 2500K-3500KAWS | Agile | Apache Kafka | CI/CD | CachingSenior-level Full TimeBengaluru, Karnataka, India3d ago
-
D&T Lead - Data Engineer INR 1500K-2500KBatch Processing | CI/CD | Cloud Data | Cloud data warehousing | ConfluenceSenior-level Full TimePune, IN3d ago
-
Senior AI-ML Platform Engineer / Tech Lead INR 2500K-5000KAI Foundry | API Gateway | API Keys | AWS Bedrock | AWS CloudFormationInclusion and Belonging CultureSenior-level Full TimeBangalore, Karnataka, IN, 5601003d ago
-
Senior Data Engineer, BizTech INR 3080K-4400KAmazon Redshift | Apache Flink | Apache Kafka | Apache Spark | Batch ProcessingSenior-level Full TimeBangalore, India3d ago
-
AWS | Automation | Data Governance | Data Modeling | Data PipelinesContinuous technical learning | Hands-on leadership | Professional developmentSenior-level Full TimeIndia3d ago
-
Technical Lead-Data Engg INR 2000K-4500KAgent Bricks | Agentic AI | Apache Spark | Data Ingestion | Data ModelingSenior-level Full TimeINDIA - NOIDA- BIRLASOFT OFFICE, IN3d ago
-
Data Quality Controls Oversight Lead INR 2771K-4000KAWS | Cloud Computing | Controls governance | Data Architecture | Data GovernanceSenior-level Full TimePune, Gera Commerzone SEZ, India3d ago
-
Lead Software Engineer INR 4000K-5000K.NET | AI Workflow Orchestration | AI workflow | ASP.Net Core | AWSSenior-level Full TimeBangalore, India3d ago
-
Lead AI Engineer INR 3000K-4000KAI Foundry | AI Studio | Airflow | Azure AI | Azure AI FoundryAccident insurance | Career coaching | Employee policies | Health benefits | Reward & recognitionSenior-level Full TimeGurugram, Haryana, India3d ago
-
Contractor INR 1300K-2600KAzure Data | Azure Data Factory | Azure Databricks | Data Factory | Data GovernanceMid-level ContractINDIA, Noida3d ago
-
Senior-level Full TimeBangalore,India3d ago
-
Senior-level Full TimePrimary location: Bengaluru, India3d ago
-
Lead AI Engineer (Agentic Systems) INR 3264K-4800KAPI Design | AWS | AWS AgentCore | AWS Neptune | Asynchronous programmingSenior-level Full TimeIN - GURUGRAM DLF DOWNTOWN BLOCK …3d ago
-
Senior Manager Data Engineering INR 3000K-4300KApache Airflow | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageSenior-level Full TimePrimary location: Hyderabad, India3d ago
-
Data Analytics Lead INR 2771K-4064KData Quality | Data Quality Management | Data Visualization | Hypothesis Testing | Microsoft ExcelCharity match program | Employee assistance program | Group medical insurance | Paid time off | Parental leaveSenior-level Full TimeGurgaon - Cyber Park, India R3d ago
-
Assistant Vice President - Data Analytics INR 4000K-5199KAgile | Automation | Case design | Cloud Platforms | Data VisualizationExecutive-level Full TimeLocation(s): Chennai, Tamil Nadu, India3d ago
-
Manager, AI & Data Engineering INR 1860K-3465KAWS | Amazon Web Services | Batch Processing | CI/CD | Cloud ArchitectureHealth programs | Security programs | Well-being programsSenior-level Full TimeEcospace Campus 3A, 4th Floor, Outer …3d ago