Azure Data Engineer
Tasks
- Build and maintain data pipelines
- Build monitoring dashboards and alerting
- Collaborate with cross-functional teams
- Convert workflows and mappings for migration
- Create data models including star snowflake and Data Vault
- Design and implement ETL/ELT processes
- Develop automated testing and data quality frameworks
- Develop transformation logic using T SQL Spark SQL PySpark
- Implement incremental loading patterns
- Implement logging, error handling, and retries
- Maintain technical documentation
- Manage environment promotions and security best practices
- Migrate legacy ETL to Fabric and Azure
- Optimize pipeline performance
- Support CI/CD pipelines
- Troubleshoot and optimize production pipelines
Perks/Benefits
Skills/Tech-stack
Apache Spark | Azure Data | Azure Data Factory | Azure DevOps | CDC | CI/CD | Data Cataloging | Data Factory | Data Governance | Data Lineage | Data Vault | Data masking | Databricks | Dataflows Gen2 | Delimited formats Polyqurt Avro | Delta Lake | Dimensional Modeling | Encryption | Git | Informatica PowerCenter | JSON | Metadata Management | Microsoft Fabric | Notebooks | PySpark | Python | RBAC | REST APIs | Spark SQL | T-SQL | Watermarking | XML
Education
Roles
Related jobs
-
Gen AI Developer INR 2000K-3000KAPI Integration | Claude API | Context Management | CrewAI | FastAPIMid-level Full TimeIN-MH-Pune2h ago
-
Staff Software Engineer, Android Embedded Software INR 2000K-3200KAndroid | C++ | Distributed Systems | Java | Performance optimizationSenior-level Full TimeBengaluru, Karnataka, India4h ago
-
DE&A - AWS - Data Engineer + Data Platform Support INR 3000K-4000KAmazon Bedrock | Amazon EC2 | Amazon EMR | Amazon S3 | Amazon SageMakerSenior-level Full TimePune, Maharashtra, India4h ago
-
Mid-level Full TimeMumbai, Maharashtra, India4h ago
-
Mid-level Full TimeBangalore, Karnataka, India8h ago
-
Assistant Manager - Forward Deployed Engineer / AI Engineer INR 1800K-2500KAgent-based | Agent-based frameworks | Autogen | Claude | Cloud ComputingMid-level Full TimeBangalore, Karnataka, India8h ago
-
Senior-level Full TimeHyderabad, India8h ago
-
Sr. Data Engineer INR 2800K-4000KCloud warehousing | DAX | Dashboard Design | Data Quality | Data StorytellingCommunity outreach programs | Employee Resource Group | Employee stock purchase program | Health and wellness incentivesSenior-level Full TimeBangalore, KA, IN, 5600379h ago
-
Lead Software Engineer - Java, AWS, GraphSQL, Data science INR 2500K-4500KAWS | Amazon ECS | Amazon EKS | Application Resiliency | CI/CDSenior-level Full TimeHyderabad, Telangana, India9h ago
-
Senior-level Full TimeGurgaon, Haryana, India9h ago
-
Software Engineer INR 1000K-1496KBitbucket | Data Architecture | Data Modeling | Data Pipelines | LinuxEmployee Assistance Program (EAP) | Flexible working environment | LinkedIn Learning | Volunteer time offMid-level Full TimeChennai, TN, India9h ago
-
Data Scientist- GenAI Engineer INR 2000K-3000KA/B | A/B Testing | B testing | Causal Inference | ClusteringMid-level Full TimeNoida, Uttar Pradesh, India9h ago
-
Applied AI ML Associate INR 2000K-3000KAI Agents | AWS Cloud | Advanced Analytics | Big Data | CI/CDSenior-level Full TimeHyderabad, Telangana, India9h ago
-
Analytics Solutions Associate - Data Strategy INR 800K-1250KAWS Databricks | AWS Redshift | Data Governance | Data Privacy | Data QualityMid-level Full TimeBengaluru, Karnataka, India10h ago
-
Senior AI Engineer- Consultant INR 3000K-4800KAgent Orchestration | Agentic AI | Azure | Classification | ClusteringCareer advancement opportunities | Collaborative work culture | Continuous learning | Inclusive workplaceSenior-level Full TimeBangalore, Karnataka, India10h ago
-
GIS Data Engineer II INR 2000K-2400KAWS | Amazon Athena | Amazon EC2 | Amazon RDS | Amazon S3MentorshipSenior-level Full TimeMumbai, MH, India11h ago
-
C# | C++ | Go | Infrastructure automation | JavaSenior-level Full TimeBengaluru, Karnataka, IND15h ago
-
Amazon S3 | C# | C++ | Data Migration | Data replicationSenior-level Full TimeBengaluru, Karnataka, IND15h ago
-
Sr Engineer-Data Engg INR 1500K-2300KAzure AI | Azure SQL | Azure Synapse | Azure Synapse Analytics | DAXSenior-level Full TimeINDIA - BENGALURU - HP, IN15h ago
-
Software Engineer - Embedded & Functional Safety Software INR 1753K-3440KAgile | Automated testing | C# | C++ | CAN busSenior-level Full TimeBangalore, IN15h ago
-
Software Engineer - Robot Navigation, Localization & SLAM INR 1753K-2372K3D camera | Agile | Automated testing | C++ | CI/CDMid-level Full TimeBangalore, IN15h ago
-
Software Engineer - Robot Connectivity & Wi Fi Systems INR 1000K-2000KAgile | Automated testing | CI/CD | GRPC | GitCustomer-facing workSenior-level Full TimeBangalore, IN15h ago
-
AI Software Engineer INR 1753K-2600KAWS | Agent/tool use | Apache Spark | Azure | ContainersContinuing education program | Continuous learning | Family-friendly perks | Financial wellness programs | Flexible time offEntry-level Full TimeIN - HYDERABAD ORION, India15h ago
-
Apache Spark | Azure Blob | Azure Blob Storage | Azure Data | Azure Data FactoryFlexibility programmes | Inclusive benefits | Mentorship | Wellbeing supportSenior-level Full TimeNoida, India15h ago
-
IN_Manager_SSIS_Data & Analytics_Advisory_Noida INR 1500K-2000KAWS | Azure | CI/CD | Cloud Data | Cloud Data PlatformsFlexibility programmes | Inclusive benefits | MentorshipMid-level Full TimeNoida, India15h ago