Azure Data Engineer
Bengaluru, KA, India
INR 1500K-2000K (estimate) Senior-level Full Time
Tasks
- Build and maintain scalable data pipelines
- Build data quality checks
- Collaborate with cross-functional teams
- Create dimensional and Data Vault models
- Design medallion architecture in Fabric Lakehouse
- Develop automation testing and monitoring dashboards
- Develop transformation logic with T-SQL Spark SQL PySpark Dataflows
- Implement incremental loading with CDC watermarking delta detection
- Implement security best practices
- Maintain technical documentation
- Perform data reconciliation and testing
- Recode legacy ETL to Fabric/ADF
- Support CI/CD and environment promotion
- Troubleshoot and optimize pipelines
Perks/Benefits
- 401k
- Competitive salaries
- Health insurance
- Office amenities
- Scholarship opportunities
- Volunteer programs
Skills/Tech-stack
Apache Spark | Avro | Azure Data | Azure Data Factory | Azure DevOps | CDC | Data Factory | Data Governance | Data Lineage | Data Vault | Data masking | Databricks | Dataflows Gen2 | Delta Lake | DevOps | Dimensional Modeling | Encryption | Fabric notebooks | Git | Informatica PowerCenter | JSON | Metadata Management | Microsoft Fabric | Parquet | PySpark | RBAC | REST APIs | Security standards | Spark SQL | T-SQL | Terraform | Watermarking | XML
Education
N/A
Roles
Related jobs
-
Data Management AI Lead INR 2500K-3380KAWS | Agent Orchestration | Agent systems | Azure | Cloud DataSenior-level Full TimeBangalore, Karnataka, IN1h ago
-
Senior-level Full TimeBengaluru, INDIA, India2h ago
-
Lead Data Engineer - Tieto Tech Consulting (m/f/d) INR 2400K-2800KAzure | Azure Data | Azure Data Factory | CI/CD | Data FactoryContinuous learning | Flexible hybrid work model | Open culture | Professional growth | Work-life balanceSenior-level Full TimeBangalore, India3h ago
-
Sr Data Engineer INR 3200K-4600KAWS | Apache Airflow | Apache Spark | Data Modeling | Google CloudCommuter benefits | Disability coverage | Financial wellness support | Healthcare | Life insuranceSenior-level Full TimeBengaluru, India4h ago
-
Senior-level Full Timebengaluru, India4h ago
-
Principal Engineer – Data Platform INR 2000K-2000KAWS | Access Control | Apache Flink | Apache Iceberg | Apache KafkaContinuous learning | Culture first work environment | High-trust work environment | Unlimited vacation policySenior-level Full TimeBengaluru5h ago
-
AI Engineer - Full-Stack & Applied UI INR 2500K-4500KABAC | AI SDK | JavaScript | LLM | MCPCollaborative team environment | Flexible work arrangementsSenior-level Full TimeBangalore5h ago
-
Mid-level Full TimeHyderabad, Telangana, India; Open to Remote … R16h ago
-
Lead - Data Platform Engineering INR 2000K-2156KAmazon Redshift | Apache Airflow | Apache Flink | Apache Kafka | Apache SparkSenior-level Full TimeHyderabad, India17h ago
-
Data Engineer INR 1500K-2300KAmazon Redshift | Amazon Web Services | Apache Airflow | Apache Kafka | Apache SparkOffice based 5 days per weekMid-level Full TimeGurgaon, India18h ago
-
Senior Analytics Engineer I INR 2535K-3500KAirflow | Amazon S3 | CI/CD | Cloud Storage | Command LineHybrid work modelSenior-level Full TimeGurugram18h ago
-
CI/CD | Cloud Platforms | Data Architectures | Data Engineering | Data ModelingHybrid work | Immediate join | VIRTUAL interviewMid-level ContractBangalore North, India19h ago
-
Senior-level Full TimeHyderabad, India19h ago
-
Software Engineer (2024 / 25, GenAI must) INR 1100K-1500KAgile | CI/CD | Deep learning | Full SDLC | Generative AIHybrid work | MentorshipMid-level Full TimeBengaluru, INDIA, India21h ago
-
Senior-level Full TimeHybrid, Hyderabad, Telangana, India R21h ago
-
Lead BI Engineer (GenAI) INR 2500K-3380KAI Agents | Azure SQL | DAX | Data Modeling | Data WarehousingCareer growth | Certification support | Growth chats | Idea tanks | MentorshipSenior-level Full TimeHyderabad, TS, India21h ago
-
Mid-level Full TimeChennai, Tamil Nadu, India22h ago
-
AWS Data Engineer - Consultant INR 720K-764KAWS Glue | AWS Lambda | AWS Step Functions | Amazon Athena | Amazon EMRMid-level Full TimeBangalore, Karnataka, India23h ago
-
AWS Data Engineer - Consultant INR 720K-764KAWS Glue | AWS Lambda | AWS Step Functions | Amazon Athena | Amazon EMRMid-level Full TimeBangalore, Karnataka, India23h ago
-
Gen AI - Consultant INR 2500K-4500KAWS SageMaker | Apache Airflow | Azure Machine Learning | CI/CD | Cloud ComputingSenior-level Full TimeBangalore, Karnataka, India23h ago
-
Gen AI - Consultant INR 2500K-4500KAPI Design | AWS SageMaker | Apache Airflow | Apache Spark | Azure MLAccess to AI research labs and cloud platforms | Certification access | Mentoring opportunities | Work on global clientsSenior-level Full TimeBangalore, Karnataka, India1d ago
-
Software Engineer III-( Java, AWS & Pyspark ) INR 2000K-2200KAWS | AWS Athena | AWS Glue | AWS Kinesis | AWS Lake FormationSenior-level Full TimeMumbai, Maharashtra, India1d ago
-
Software Engineer I - Data Infrastructure INR 1200K-1500KAlgorithms | C++ | Data Structures | Database Proxy | Database replicationInclusive culture | Professional developmentMid-level Full TimeBangalore, India1d ago
-
Senior Data Engineer INR 2500K-2829KAWS | Apache Airflow | Apache Iceberg | Apache Spark | AzureEmployee Assistance Program (EAP) | Flexible working environment | LinkedIn Learning | Volunteer time offSenior-level Full TimeChennai, TN, India1d ago
-
Data & AI DevSecOps Specialist INR 2298K-2675KAccess Control | CI/CD | Cloud platform | Data Classification | Data PrivacySenior-level Full TimeBengaluru, IN, 5601031d ago