Module Lead - Azure Data Factory (ADF) Job
Tasks
- Automate CI/CD deployments
- Build scalable data pipelines
- Configure ADF triggers
- Configure discovery and access control
- Configure self hosted integration runtime
- Create reusable notebooks
- Design ETL pipelines
- Develop PySpark data transformations
- Implement ADF parameterization
- Implement data lineage
- Implement incremental loads
- Integrate relational sources
- Manage governance with Unity Catalog
- Manage staging and warehouse loads
- Migrate ADF pipelines across environments
- Optimize data transformations
- Process flat files
- Set up managed identity connections
- Understand end-user requirements
- Use ARM templates for infrastructure changes
Perks/Benefits
- Agile work culture
- Continuous learning
- Flexible work arrangements
- Inclusive team environment
- Stable employment
Skills/Tech-stack
ARM Templates | Azure Data | Azure Data Factory | Azure DevOps | Azure SQL | Azure Synapse | CI/CD | DB2 | Data Factory | Data Governance | Data Lineage | Data Pipelines | Databricks | ETL | Flat Files | Incremental loads | Integration runtime | Managed Identity | Oracle | PL/SQL | PySpark | Reusable Notebooks | SQL Server | Self Hosted | Self-Hosted Integration Runtime | T-SQL | UDF | Unity Catalog
Education
N/A
Related jobs
-
Data Engineer I INR 1500K-2000KAWS | Apache Spark | Automated testing | Azure | Azure DataHybrid work | Inclusive work environment | Professional developmentMid-level Full TimeBangalore, Karnataka, IN3h ago
-
Data Engineer I INR 1500K-2000KApache Spark | Automated testing | Azure Data | Azure Data Factory | Azure DatabricksCareer development | Learning opportunitiesMid-level Full TimeBangalore, Karnataka, IN3h ago
-
Data Analyst/ETL Engineer INR 1500K-2500KAWS Glue | BI tools | Data Flows | Data Transformations | ETLMid-level Full TimeChennai, India4h ago
-
Senior AI Engineer INR 2500K-5000KAWS | Azure | BM25 | CI/CD | ContainerizationFlexible work environment | Remote work options | Self-care supportSenior-level Full TimeHyderabad, India5h ago
-
AI Agents | AWS Bedrock | Azure OpenAI | CI/CD | Claude CodeCareer growth | Continuous learning | Hybrid work | Remote work | Work-life balanceSenior-level Full TimeIndia5h ago
-
Senior Software Engineer II - Data Engineering and Platform INR 1500K-2000KAWS | Agile | Apache Airflow | Apache Kafka | Apache SparkMid-level Full TimeBangalore, India5h ago
-
Bash | Data Pipelines | Data Processing | Docker | GCPAsynchronous culture | Competitive salary | Friendly work environment | Remote-friendlyMid-level Full TimeKolkata, India6h ago
-
Software Engineer II, Data Engineer INR 2520K-3880KAWS | Apache Airflow | Apache Spark | Azure | Cloud platformCareer growth | Learning & MentorshipSenior-level Full TimeBangalore, India6h ago
-
Senior Data Engineer - Supply Chain & Analytics Platforms INR 2800K-4200KAWS | Apache Airflow | Azure | CI/CD | Cloud StorageSenior-level Full TimeBengaluru, INDIA, India6h ago
-
AWS Glue | AWS IAM | AWS Lambda | Airflow | Amazon CloudWatchCollaborate with experienced engineering teams | Continuous learning and professional development | Remote work | Work on impactful business intelligence initiatives | Work on large scale cloud data transformation projectsMid-level Full TimeIndia7h ago
-
AI Foundry | AWS | Azure | Azure AI | Azure AI FoundryMid-level Full TimeBengaluru Millenia, India11h ago
-
ADLS Gen2 | AKS | Adaptive Query | Adaptive query execution | Apache SparkFlexibility programmes | Inclusive benefits | Mentorship | Mentorship programs | Wellbeing supportSenior-level Full TimeBengaluru Millenia, India11h ago
-
IN_Sr Associate_ GenAI and Agentic AI_GCC_ Advisory_ Noida INR 2500K-5000KAPI Development | Agent safety | Async Programming | Autogen | CI/CDSenior-level Full TimeNoida, India11h ago
-
IN_Associate_GenAI and Agentic AI_GCC_Advisory_Bangalore INR 2000K-4500KAI/ML | AI/ML Pipelines | Agent systems | Apache Spark | AutogenEntry-level Full TimeBengaluru Millenia, India11h ago
-
Principal Engineer - Data USD 14KAzure Data | Azure Data Factory | Azure Databricks | Azure DevOps | CI/CDCertificate reimbursement | Health benefits | Medical insurance | Professional development | Shift allowanceSenior-level Full TimeGurugram, HR, IN11h ago
-
Azure Data | Azure Data Factory | Azure Databricks | Azure DevOps | CI/CDCertificate reimbursement | Health benefits | Medical insurance | Professional development | Shift allowanceSenior-level Full TimeGurugram, HR, IN11h ago
-
Subcontractor INR 1500K-2500KAWS Cloud | AWS Cloud Services | Access Controls | Cloud services | Data ModelingSenior-level ContractINDIA - PUNE - BIRLASOFT OFFICE …11h ago
-
AI and Machine Learning Engineer INR 2500K-4200KAWS | Azure | CI/CD | Data Analysis | Deep learningHealth benefits | Hybrid work flexibility | Professional development programsMid-level Full TimeBengaluru, Karnātaka, India11h ago
-
Sr Engineer Data INR 2000K-4200KAWS | AWS Lambda | Agile | CI/CD | Data GovernanceFlexible work environment | Inclusive workplace | Internal mobility | Volunteering support | Well-beingSenior-level Full TimeKA Bangalore, India11h ago
-
Systems Integration Senior Specialist INR 3500K-5500KAPI Integration | Agent workflows | Agile | Audit Logging | AuthenticationSenior-level Full TimeAny NTT Location, KA, IN11h ago
-
Mid-level Full TimeNoida,Uttar Pradesh,India R16h ago
-
Senior Engineer, Machine Learning Ops (India) INR 3700K-5400KAWS | Agent Orchestration | Alerting | Azure | Azure ContainerSenior-level Full TimeBengaluru, Karnataka, India17h ago
-
Senior-level Full TimeNoida, Uttar Pradesh, India21h ago
-
Data Engineer-Mobile Monetization - Big Data, GenAI INR 750K-1200KAI Observability | AWS | Apache Hudi | Apache Iceberg | CI/CDBroadband reimbursement | Catered lunches | Healthcare insurance | Healthy snacks | Hybrid work scheduleMid-level Full TimePune, IN R21h ago
-
Senior-level Full TimeHyderabad, India21h ago