Associate Principal Engineer, Azure Data Factory Architect
Tasks
- Architect data integration solutions in Azure Data Factory
- Collaborate with stakeholders on data integration requirements
- Define architecture standards and reusable frameworks
- Design and maintain ADF pipelines
- Develop and optimize ADF Mapping Data Flows
- Ensure data reliability scalability and high availability
- Implement CI CD for ADF using Azure DevOps
- Implement ELT workflows for near real time processing
- Implement ETL workflows for batch processing
- Integrate ADF with Azure SQL Synapse and Data Lake
- Mentor data engineers with code reviews
- Troubleshoot production issues with root cause analysis
- Tune pipeline performance and optimize cost
Perks/Benefits
- N/A
Skills/Tech-stack
ADF Pipelines | Azure Blob | Azure Blob Storage | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure Data Lake Storage Gen2 | Azure DevOps | Azure SQL | Azure SQL Database | Azure Synapse | Azure Synapse Analytics | Blob Storage | CI/CD | Cause analysis | Cost Optimization | Data Factory | Data Flows | Data Lake Storage Gen2 | Data orchestration | Datasets | Dependency management | ELT | ETL | Error Handling | Integration runtime | Linked Services | Logging | Mapping Data | Mapping data flows | Monitoring | Performance Tuning | Root Cause Analysis | Root cause | SQL | SQL Database | Scheduling | Self Hosted | Self-Hosted Integration Runtime | Synapse Analytics | Triggers
Education
Related jobs
-
Senior Data Engineer INR 3000K-4000KAPIs | AWS | AWS Glue | AWS Lambda | AgileAccess to Headspace app | Career development | Hybrid work model | Incentive programs | Mental health daysSenior-level Full TimeIndia, Bengaluru, Karnataka R1d ago
-
Software Engineer, Data Platform INR 1500K-3000KAPI | API Gateway | AWS | CI/CD | CloudWatchEmployee incentive programs | Flexible vacation | Headspace app | Hybrid work model | Mental health daysMid-level Full TimeIndia, Bengaluru, Karnataka R1d ago
-
Senior Staff Engineer, Gen AI, Azure INR 2000K-4000KAI/ML | API Development | Azure AI | Azure AI/ML | Backend DevelopmentSenior-level Full TimeRemote, India R2d ago
-
Senior Staff Engineer,GenAI, Playwright INR 1800K-2829KAI Agents | API Testing | Agile | BDD | CI/CDSenior-level Full TimeRemote, India R2d ago
-
Databricks Engineer/ Architect INR 1500K-2000KAWS | Apache Spark | Azure | Cloud platform | Data GovernanceSenior-level Contract Full TimeIndia - Remote R3d ago
-
Senior Principal Engineer - Data Engineering INR 3000K-4000KAWS | Apache Spark | Automation | Azure Data | Azure Data FactoryHybrid work environment | Inclusive culture | Professional development opportunities | Supportive leadersSenior-level Full TimePune - Panchshil, India R3d ago
-
Associate, Data Engineer INR 1400K-2700KApache Airflow | Azure Blob | Azure Blob Storage | Azure Event | Azure Event GridComprehensive healthcare | Flexible time off | Flexible-hybrid work | Tuition reimbursementMid-level Full TimeM11 - Commers III, 43, 44 … R3d ago
-
Staff Software Engineer - Semantic Layer INR 3000K-4000KAPI Design | Amazon Redshift | Backwards Compatibility | BigQuery | CompilationSenior-level Full TimeIndia - Remote R3d ago
-
AI Assisted Development | API Integration | Claude | Codex | Data ModelingLaptop provided | Medical insurance | Mentorship | No weekend work | Remote workSenior-level Full TimeIndia R4d ago
-
API Integration | Data Modeling | Database Design | ETL | HTMLAI training | Community forums | Laptop provided | Medical insurance | MentorshipSenior-level Full TimeIndia R4d ago
-
Computer Scientist - Fullstack INR 1800K-3500KAsynchronous programming | Bazel | CI/CD | Distributed Systems | ExpressMid-level Full TimeBangalore, India R4d ago
-
Data Architect, Master Data Management INR 2100K-2600KAPI Integration | Alation | Batch Processing | Cloud Data | Cloud Data ArchitectureFlexible work-life balance | Headspace app access | Hybrid work model | Mental health days | Retirement savingsSenior-level Full TimeIndia, Bengaluru, Karnataka R4d ago
-
Senior Software Data Engineer INR 2400K-3380KAWS | AWS Glue | AWS Lambda | Adobe Analytics | AirflowSenior-level Full TimeAPAC - India - Offsite/Home R4d ago
-
Vice President, Data Quality Lead Engineer INR 3000K-4000KAPI Design | Airflow | Anomaly Detection | CI/CD | DBTFlexible time off | Flexible working model | Healthcare | Retirement plan | Tuition reimbursementSenior-level Full TimeM11 - Commers III, 43, 44 … R4d ago
-
ML Engineer -Signal Processing / ASR INR 2500K-4500KAudio classification | Automatic Speech Recognition | CPU Utilization | Cost Optimization | Data AnalysisMid-level Full TimeIndia (Remote) R4d ago
-
Looker Data Engineer (Contract) INR 2516K-3356KBusiness Intelligence | DBT | Data Modeling | LookML | LookerSenior-level ContractIndia, Remote R4d ago
-
AI/ML | AWS | Azure | Azure Data | Azure Data FactoryFlexible working hours | Remote WorkingSenior-level Full TimeIndia R5d ago
-
Associate Principal Engineer, Data Science INR 1500K-2000KANOVA | CI/CD | Cloud Architecture | Deep learning | GCPMid-level Full TimeRemote, India R5d ago
-
Associate Principal Engineer, Data Science INR 1800K-2500KANOVA | AWS | Azure | CI/CD | Cloud ArchitectureMid-level Full TimeRemote, India R5d ago
-
Associate Principal Engineer, Data Science INR 1500K-2000KANOVA | AWS | Azure | CI/CD | Cloud ArchitectureMid-level Full TimeRemote, India R5d ago
-
Business Intelligence Engineer - Power BI INR 712K-1200KAgile | DAX | Data Modeling | Data Quality | Data WarehousingFlexible hybrid schedule | Health insurance | Life insurance | Paid time off | Personal/family care leaveMid-level Full TimeHyderabad, India R5d ago
-
APIs | Airbyte | Airflow | DBT | Data ModelingFully remote | Home office setup budget | Language learning sessions | Paid sick days | Paid time offSenior-level Full TimeIndia R5d ago
-
Associate, Data Engineer (Test Automation) INR 1524K-2156KAPI Testing | AWS | Azure | CI/CD | Cause analysisComprehensive healthcare | Flexible time off | Hybrid work model | Retirement plan | Support for working parentsMid-level Full TimeBL4 - KNG Tower 1, Indiqube … R5d ago
-
Backend Ops Engineer Role INR 2000K-3500KAWS | Azure | CI/CD | Compliance | Cost OptimizationRemote workMid-level Full TimeIndia - Remote R5d ago
-
APIs | AWS | Automated testing | Azure | ClassificationEducational assistance | Flexible working hours | In-house soft skills training | Medical insuranceSenior-level Full TimeRemote - India R6d ago