Azure Data Engineer
Bengaluru, KA, India
INR 1500K-2000K (estimate) Senior-level Full Time Found 9d ago
Tasks
- Build and maintain scalable data pipelines
- Build data quality checks
- Collaborate with cross-functional teams
- Create dimensional and Data Vault models
- Design medallion architecture in Fabric Lakehouse
- Develop automation testing and monitoring dashboards
- Develop transformation logic with T-SQL Spark SQL PySpark Dataflows
- Implement incremental loading with CDC watermarking delta detection
- Implement security best practices
- Maintain technical documentation
- Perform data reconciliation and testing
- Recode legacy ETL to Fabric/ADF
- Support CI/CD and environment promotion
- Troubleshoot and optimize pipelines
Perks/Benefits
- 401k
- Competitive salaries
- Health insurance
- Office amenities
- Scholarship opportunities
- Volunteer programs
Skills/Tech-stack
Apache Spark | Avro | Azure Data | Azure Data Factory | Azure DevOps | CDC | Data Factory | Data Governance | Data Lineage | Data Vault | Data masking | Databricks | Dataflows Gen2 | Delta Lake | DevOps | Dimensional Modeling | Encryption | Fabric notebooks | Git | Informatica PowerCenter | JSON | Metadata Management | Microsoft Fabric | Parquet | PySpark | RBAC | REST APIs | Security standards | Spark SQL | T-SQL | Terraform | Watermarking | XML
Education
N/A
Roles
Language: en |
Views: 1 |
Clicks: 0
Related jobs
-
Mid-level Full TimeIN-TN-Chennai1d ago
-
Mid-level Full TimeMaharashtra, Pune, India1d ago
-
Custom Software Engineer INR 885K-1200KApplication development | Azure Data Services | Cloud Computing | Data Services | Data integrationMid-level Full TimeChennai, CDC2E, India1d ago
-
Custom Software Engineer INR 960K-1475KApplication development | Azure Data Services | Cloud Computing | Data Services | Data integrationMid-level Full TimeHyderabad, HDC3B, India1d ago
-
Lead Consultant-Data Engineer INR 2486K-3380KAWS | Apache Hadoop | Apache Kafka | Apache Spark | AzureAI certifications | Career growth | Hands-on experience | Innovative environment | MentorshipSenior-level Full TimeIndia-Bangalore2d ago
-
Principal Consultant-Data Engineer INR 2486K-3380KAWS | Amazon Redshift | Apache Hadoop | Apache Kafka | Apache SparkAI certifications | Career growth | Inclusive culture | MentorshipSenior-level Full TimeIndia-Bangalore2d ago
-
Data Engineer INR 1500K-2500KAzure Data | Azure Data Factory | Azure Data Lake | Azure Functions | Azure SQLMid-level Full TimeIN-AP-Hyderabad2d ago
-
AWS Data Engineer INR 2000K-2125KAWS | Best practices | CI/CD | Cloud Architecture | Cloud platformSenior-level Full TimeIN-TN-Chennai2d ago
-
Senior-level Full TimeIN-TN-Chennai2d ago
-
Software Engineer INR 1600K-2400KAgile tools | Agile tools (JIRA, Rally) | Agile tools (Jira | Angular | BigQueryMid-level Full TimeChennai, Tamil Nadu, India2d ago
-
DevOps Engineer III - Kubernetes, AWS, Terraform INR 2200K-3065KAWS | Aurora | Automation | CI/CD | CNI pluginsSenior-level Full TimeHyderabad, Telangana, India2d ago
-
Group BI Engineer I INR 2000K-2040KAgile | Azure Analysis | Azure Analysis Service | Azure Data | Azure Data LakeMid-level Full TimeBangalore, Karnataka, India2d ago
-
Senior-level Full TimeBangalore, INDIA, India2d ago
-
Senior-level Full TimeBangalore, INDIA, India2d ago
-
Senior-level Full TimeGurugram, Haryana, India2d ago
-
GCP Data Engineer - Associate Director INR 1500K-2541KBigQuery | Cloud Composer | Cloud Functions | DBT | DataflowMid-level Full TimeHyderabad, Telangana, India2d ago
-
Senior AI Applications Engineer INR 3100K-4600KAI Agents | CI/CD | Cloud AI | Cloud Native | Cloud-native ArchitecturesInclusive work environment | Life insurance | Medical benefits | Retirement options | Volunteer programsSenior-level Full TimeIndia2d ago
-
Senior-level Full TimeBengaluru, KA, IN; Hyderabad, TS, IN2d ago
-
Lead Software Engineer - Data Engineering (Python, AWS, ETL) INR 2000K-2200KAWS | AWS Glue | Agile | Athena | CI/CDSenior-level Full TimeMumbai, Maharashtra, India2d ago
-
Senior-level Full TimeHyderabad, Telangana, India2d ago
-
Mid-level Full TimeRMZ Ecoworld, Devarabeesanahal, Bengaluru, India2d ago
-
Software Senior Engineer INR 3000K-4225KAI frameworks | AI frameworks TensorFlow | Algorithms | Angular | Cloud infrastructureSenior-level Full TimeBangalore, India2d ago
-
Software Development Advisor INR 2520K-3380KAWS CDK | AppFlow | Aurora | Data Pipeline Architecture | Data ProcessingSenior-level Full TimeChennai, TN, IN2d ago
-
Lead Full Stack Engineer INR 2500K-2829KAI Tooling | AWS | Agile | Airflow | AngularCareer growth | Healthcare | Hybrid work | Paid time offSenior-level Full TimeIND-Pune-Equifax Analytics-PTEC, India2d ago
-
Network Operations Security Engineer INR 2092K-2500KCloud Computing | DevOps | Firewall Configuration | Monitoring Tools | Network AutomationHealthcare | Hybrid work | Online learning platform | Paid time offSenior-level Full TimeIND-Pune-Equifax Analytics-PTEC, India2d ago