Azure Data Engineer
Bengaluru, KA, India
INR 1500K-2000K (estimate) Senior-level Full Time
Tasks
- Build and maintain scalable data pipelines
- Build data quality checks
- Collaborate with cross-functional teams
- Create dimensional and Data Vault models
- Design medallion architecture in Fabric Lakehouse
- Develop automation testing and monitoring dashboards
- Develop transformation logic with T-SQL Spark SQL PySpark Dataflows
- Implement incremental loading with CDC watermarking delta detection
- Implement security best practices
- Maintain technical documentation
- Perform data reconciliation and testing
- Recode legacy ETL to Fabric/ADF
- Support CI/CD and environment promotion
- Troubleshoot and optimize pipelines
Perks/Benefits
- 401k
- Competitive salaries
- Health insurance
- Office amenities
- Scholarship opportunities
- Volunteer programs
Skills/Tech-stack
Apache Spark | Avro | Azure Data | Azure Data Factory | Azure DevOps | CDC | Data Factory | Data Governance | Data Lineage | Data Vault | Data masking | Databricks | Dataflows Gen2 | Delta Lake | DevOps | Dimensional Modeling | Encryption | Fabric notebooks | Git | Informatica PowerCenter | JSON | Metadata Management | Microsoft Fabric | Parquet | PySpark | RBAC | REST APIs | Security standards | Spark SQL | T-SQL | Terraform | Watermarking | XML
Education
N/A
Roles
Related jobs
-
Data Management AI Lead INR 2500K-3380KAWS | Agent Orchestration | Agent systems | Azure | Cloud DataSenior-level Full TimeBangalore, Karnataka, IN3h ago
-
Senior-level Full TimeBengaluru, INDIA, India4h ago
-
Lead Data Engineer - Tieto Tech Consulting (m/f/d) INR 2400K-2800KAzure | Azure Data | Azure Data Factory | CI/CD | Data FactoryContinuous learning | Flexible hybrid work model | Open culture | Professional growth | Work-life balanceSenior-level Full TimeBangalore, India5h ago
-
Senior Automation Engineer INR 2156K-2647KALB | API Gateway | AWS Lambda | Agile | Amazon CloudWatchSenior-level Full TimeHyderabad, India6h ago
-
Sr Data Engineer INR 3200K-4600KAWS | Apache Airflow | Apache Spark | Data Modeling | Google CloudCommuter benefits | Disability coverage | Financial wellness support | Healthcare | Life insuranceSenior-level Full TimeBengaluru, India6h ago
-
Senior-level Full Timebengaluru, India6h ago
-
Principal Engineer – Data Platform INR 2000K-2000KAWS | Access Control | Apache Flink | Apache Iceberg | Apache KafkaContinuous learning | Culture first work environment | High-trust work environment | Unlimited vacation policySenior-level Full TimeBengaluru6h ago
-
AI Engineer - Full-Stack & Applied UI INR 2500K-4500KABAC | AI SDK | JavaScript | LLM | MCPCollaborative team environment | Flexible work arrangementsSenior-level Full TimeBangalore7h ago
-
Systems Integration Specialist Advisor INR 2516K-3356KAWS | Azure | Azure Data | Azure Data Factory | Azure Data LakeSenior-level Full TimeBangalore, KA, IN11h ago
-
Data Engineer (PySpark) INR 1500K-2500KAI Assisted Development | Data Mapping | Data Modeling | Data Warehousing | Data profilingMid-level Full TimeBengaluru, Karnataka, India11h ago
-
Data Engineer (PySpark) INR 1500K-2000KData Compliance | Data Governance | Data Mapping | Data Pipeline Architecture | Data ProcessingMid-level Full TimeBengaluru, Karnataka, India11h ago
-
Senior Data Engineer INR 2520K-3380KAPI Authentication | Continuous integration | DevOps | Docker | DruidSenior-level Full TimeChennai, TN, IN11h ago
-
Data Engineer (PySpark/Informatica BDM) INR 500K-575KAWS | Azure | CI/CD | Data Governance | Data MappingSenior-level Full TimeBengaluru, Karnataka, India11h ago
-
EDS-Senior Associate-Databricks INR 1431K-2000KAzure Data | Azure Data Factory | Azure Databricks | Data Factory | Data GovernanceSenior-level Full TimeTrivandrum, KL, IN, 69558111h ago
-
Power BI Engineer INR 800K-1500KAzure Data | Azure Data Factory | Azure SQL | Azure Synapse | Azure Synapse AnalyticsSenior-level Full TimeChennai, Tamil Nadu, India11h ago
-
Senior AI Application Engineer, Enterprise AI INR 2500K-4500KAWS Bedrock | Agile | Amazon Web Services | Azure | Azure OpenAIRelocation assistance providedSenior-level Full TimeIND19-01-Bengaluru-EPIP 122 (Phase II), India11h ago
-
EDS-Associate-PowerBI and SQL INR 2000K-3000KAzure Data | Azure Data Factory | Azure Databricks | Data Factory | Data GovernanceMid-level Full TimeTrivandrum, KL, IN, 69558111h ago
-
Technology Engineer - Kafka & Streaming Platform INR 2000K-2245KAWS | Apache Kafka | Argo CD | Azure | CI/CDSenior-level Full TimeChennai, Tamil Nadu, India11h ago
-
Technology Engineer - Redis & Streaming Platforms INR 1837K-2000KAWS | Ansible | Apache Kafka | ArgoCD | AzureSenior-level Full TimeChennai, Tamil Nadu, India11h ago
-
Mid-level Full TimeHyderabad, Telangana, India; Open to Remote … R18h ago
-
Lead - Data Platform Engineering INR 2000K-2156KAmazon Redshift | Apache Airflow | Apache Flink | Apache Kafka | Apache SparkSenior-level Full TimeHyderabad, India18h ago
-
Data Engineer INR 1500K-2300KAmazon Redshift | Amazon Web Services | Apache Airflow | Apache Kafka | Apache SparkOffice based 5 days per weekMid-level Full TimeGurgaon, India19h ago
-
Senior Analytics Engineer I INR 2535K-3500KAirflow | Amazon S3 | CI/CD | Cloud Storage | Command LineHybrid work modelSenior-level Full TimeGurugram20h ago
-
CI/CD | Cloud Platforms | Data Architectures | Data Engineering | Data ModelingHybrid work | Immediate join | VIRTUAL interviewMid-level ContractBangalore North, India21h ago
-
Senior-level Full TimeHyderabad, India21h ago