Azure Data Engineer
Bengaluru, KA, India
INR 1500K-2000K (estimate) Mid-level Full Time
Found 10h ago
Tasks
- Build and maintain data pipelines
- Build monitoring dashboards and alerting
- Collaborate with cross-functional teams
- Convert workflows and mappings for migration
- Create data models including star snowflake and Data Vault
- Design and implement ETL/ELT processes
- Develop automated testing and data quality frameworks
- Develop transformation logic using T SQL Spark SQL PySpark
- Implement incremental loading patterns
- Implement logging, error handling, and retries
- Maintain technical documentation
- Manage environment promotions and security best practices
- Migrate legacy ETL to Fabric and Azure
- Optimize pipeline performance
- Support CI/CD pipelines
- Troubleshoot and optimize production pipelines
Perks/Benefits
Skills/Tech-stack
Apache Spark | Azure Data | Azure Data Factory | Azure DevOps | CDC | CI/CD | Data Cataloging | Data Factory | Data Governance | Data Lineage | Data Vault | Data masking | Databricks | Dataflows Gen2 | Delimited formats Polyqurt Avro | Delta Lake | Dimensional Modeling | Encryption | Git | Informatica PowerCenter | JSON | Metadata Management | Microsoft Fabric | Notebooks | PySpark | Python | RBAC | REST APIs | Spark SQL | T-SQL | Watermarking | XML
Education
Roles
Language: en |
Views: 1 |
Clicks: 0
Related jobs
-
Technical Architect AI INR 2500K-5000KAI | AI ethics | AWS | Azure | Bias MitigationFlexible work | Health benefitsSenior-level Full TimePune City, India6h ago
-
AWS Athena | AWS Glue | AWS Redshift | AWS S3 | Data LakehouseFlexible work mode | Hybrid work | Immediate startMid-level ContractBangalore North, India7h ago
-
IT Senior Associate - Quality Assurance (Automation) INR 480K-600KAPIAutomation | Agile | AutomationTesting | BugManagement | CI/CDMid-level Full TimeBengaluru, India7h ago
-
Gen AI INR 2500K-4144KAI Security | Airflow | Attention Mechanisms | Containerization | Data PipelinesSenior-level Full TimeIN-KA-Bangalore8h ago
-
Gen AI Sr Engineer INR 2500K-4144KAWS | Airflow | Attention Mechanisms | Databricks | Delta LakeFlexible working hours | Health insurance | Learning resourcesSenior-level Full TimeIN-KA-Bangalore8h ago
-
GenAI INR 2500K-4500KAsynchronous programming | CICD | Distributed Systems | Huggingface | JavaScriptSenior-level Full TimeIN-KA-Bangalore8h ago
-
Software Engineering II INR 1200K-2000KAzure | Big Data | C# | CI/CD | Cloud ComputingFlexible work arrangements | Health benefits | Learning opportunitiesMid-level Full TimeBengaluru, KA, IN9h ago
-
Forward Deployed Engineer, Cloud Applied AI INR 2500K-4500KArtificial Intelligence | CI/CD | Cloud infrastructure | Debugging | Distributed ComputingSenior-level Full TimeBengaluru, Karnataka, India9h ago
-
Forward Deployed Engineering Manager, Cloud Applied AI INR 2500K-4500KAI | BigQuery | CI/CD | Cloud Platforms | Distributed ComputingSenior-level Full TimeBengaluru, Karnataka, India9h ago
-
Senior Data Engineer Azure INR 2000K-2040KApache Spark | Azure | Azure Data | Azure Data Factory | Data FactoryCommunity contribution programs | Conferences | Flexible holidays | Hackathons | Health insuranceSenior-level Full TimeTamil Nadu, Chennai, India9h ago
-
Lead - Data Platform Engineering INR 2000K-2400KBig Data | Cloud | Cost Optimization | Data Modeling | Data WarehousingSenior-level Full TimeHyderabad, India10h ago
-
Solutions Engineer (Generative AI) INR 2829K-3250KAutomation | ChatGPT | Documentation | Generative AI | Identity ManagementHealth benefits | Paid time off | Work-life balanceMid-level Full TimeHyderabad, India10h ago
-
REF82247R_2025190189 - Senior Program Analyst - IT - Python , Pandas, AI / ML - Nasik - WFO INR 300K-300KAI | API | Automation | ML | Power AutomateEntry-level Full TimeNashik, MH, India10h ago
-
AWS | Java | Kafka | Kotlin | Language ProcessingMid-level Full TimeBengaluru, Karnataka, India11h ago
-
Software Engineer II - Java , Scala , Python , Databricks INR 1200K-2200KAWS | Agile | Big Data | CI/CD | DatabricksMid-level Full TimeMumbai, Maharashtra, India11h ago
-
Senior - Data and App Modernization INR 2100K-2400KCD pipelines | CI/CD | CI/CD pipelines | Data Analysis | Data DenormalizationSenior-level Full TimePune, Maharashtra, India11h ago
-
Data Scientist Senior Associate INR 2500K-3440KAI Agents | API Integration | AWS | Algorithms | AzureSenior-level Full TimeHyderabad, Telangana, India12h ago
-
Lead Data Engineer INR 2000K-2000KAWS | Azure | Data Architecture | Data Engineering | Data GovernanceSenior-level Full TimeTamil Nadu, Chennai, India12h ago
-
Senior-level Full TimeGurugram, Haryana, IN12h ago
-
GCP Cloud Engineer Consultant INR 2200K-3200KArtifactory | Bash | CD | CI | CI/CDContinuous learning opportunities | Flexible work hours | Health insurance | Remote work options | Team collaborationSenior-level Full TimeBangalore, Karnataka, India13h ago
-
GCP Cloud Engineer Consultant INR 2200K-3200KAWS | Alert Correlation | Anomaly Detection | Azure | BashSenior-level Full TimeBangalore, Karnataka, India13h ago
-
Senior-level Full TimePune, Maharashtra, India14h ago
-
Data Engineer- AWS+MS Fabric+ Purview INR 2000K-2400K.NET | AWS | CI/CD | Cloud Architecture | Data PipelinesSenior-level Full TimeHyderabad, Telangana, India14h ago
-
Graduate Engineer Data -Analyst - MFT - KGS CH INR 360K-420KBI Visualization | Cloud services | Containers | Data Modeling | DatabricksEntry-level Full TimeBangalore, Karnataka, India14h ago
-
Graduate Engineer Data -Analyst - MFT - KGS CH INR 360K-420KBI Visualization | Cloud Data | Cloud Data Services | Containers | Data ModelingEntry-level Full TimeBangalore, Karnataka, India14h ago