Lead Data Engineer - Azure + Fabric
Gurugram, Haryana, India
INR 1200K-2700K (estimate) Senior-level Full Time
Tasks
- Build Gold curated datasets and secure views
- Build data pipelines using Fabric Data Pipelines Synapse Pipelines and notebooks
- Build reusable ingestion pipelines and CDC frameworks
- Develop Silver transformations for cleansing and standardization
- Develop and maintain Microsoft Fabric OneLake lakehouse solutions
- Enforce data governance and security with Purview RBAC and lineage
- Implement Bronze ingestion with audit logging and schema validation
- Implement data quality checks reconciliation and monitoring
- Optimize Spark PySpark Python and SQL workloads
- Support Power BI semantic models and Direct Lake
- Troubleshoot pipeline failures performance issues and data discrepancies
Perks/Benefits
- N/A
Skills/Tech-stack
Azure | Azure DevOps | CDC | CI/CD | Data Governance | Data Ingestion | Data Lineage | Data Quality | Data Reconciliation | Data Transformation | Data Validation | Delta Lake | ELT | ETL | Git | Microsoft Fabric | Microsoft Purview | OneLake | PII/PHI | PySpark | Python | RBAC | SQL | Spark
Education
N/A
Roles
Related jobs
-
ML-Ops INR 3700K-5000KAsyncio | CI/CD | CProfile | Caching | DjangoLeadership development | Training sessionsSenior-level Full TimeMumbai, Maharashtra, India5h ago
-
Generative AI Engineer INR 1200K-2500KAI Services | AWS | Amazon SageMaker | Anthropic API | AzureCollaborative team environment | Leadership development | Training programsMid-level Full TimeMumbai, Maharashtra, India5h ago
-
Staff GenAI Engineer INR 2000K-5000KAWS | Agentic AI | Azure | CI/CD | ClassificationCollaborative team environment | Global consulting environment | Leadership development program | Mentorship programs | Training sessionsSenior-level Full TimeMumbai, MH, India5h ago
-
Mid-level Full TimeMumbai, Maharashtra, India5h ago
-
Senior-level Full TimeMumbai, Maharashtra, India5h ago
-
Databricks Engineer - Senior/ Lead INR 1500K-2800KACID | ADLS Gen2 | Apache Spark | Azure Data | Azure Data FactorySenior-level Full TimeHyderabad, TS, India7h ago
-
Data Engineer - Azure + Fabric INR 1400K-2700KAccess Control | Apache Spark | Azure Data | Azure DevOps | Azure SynapseSenior-level Full TimeGurugram, Haryana, India7h ago
-
Mid-level Full TimeNoida R7h ago
-
Senior-level Full TimeIndia7h ago
-
Staff Software Engineer (Python) INR 3700K-5000KAPI Development | Alerting | Amazon Web Services | Authentication | Batch ProcessingCollaborative team environment | Global projects | Leadership development | Training sessionsSenior-level Full TimeMumbai, MH, India7h ago
-
AI / ML Data Scientist I INR 1000K-1890KAWS | Apache Spark | Artificial Intelligence | Cloud platform | ConfluenceMid-level Full TimeBengaluru, India7h ago
-
Lead - Data Platform Engineering INR 2500K-4500KAWS | Azure | Cloud Data | Cloud Data Platforms | Customer 360Senior-level Full TimeChennai, India8h ago
-
GEN AI/Prompt engineer INR 1200K-2500KAI Agents | API Integration | API deployment | AWS Bedrock | Azure OpenAIMid-level Full TimeNoida, Uttar Pradesh, India8h ago
-
Software Engineer 2 INR 1500K-2500KAPI Design | AWS | Asynchronous Communication | Data Structures | Distributed SystemsMid-level Full TimeHybrid - Bangalore, India R8h ago
-
Lead Software Engineer (Full Stack) INR 506K.NET | AWS | Angular | Asynchronous programming | AzureRemote work flexibility | Supportive team culture | Work-life balanceSenior-level Full TimeBengaluru, Karnataka, India; Pune, Maharashtra, India8h ago
-
Senior-level Full TimeIndia, Karnataka, Bangalore8h ago
-
Senior-level Full TimeBangalore, India R8h ago
-
Senior Data Engineer INR 3000K-4000KAWS | AWS Managed Airflow | Airflow | Apache Spark | AzureMedical insurance | Remote-first workplace | Term Life and Personal Accident | Wellness allowanceSenior-level Full TimeIndia - Bangalore R9h ago
-
Mid-level Full TimeIndia, Karnataka, Bangalore9h ago
-
Airflow | Apache Spark | CI/CD | Contextual Bandits | Data DriftExposure to advanced ML technologies | Ownership across full ML lifecycle | Professional development | Supportive collaboration environmentSenior-level Full TimeIndia9h ago
-
Developer III INR 1400K-2500KAgile Scrum | Azure Data | Azure Data Factory | Cloud Storage | Cloud platformSenior-level Full TimeHitech City, TG, India9h ago
-
Senior Software Engineer - Data + AI Observability INR 1500K-3000KAIOps | AWS | Azure | C++ | Cloud platformSenior-level Full TimeBengaluru, India10h ago
-
Senior Data Engineer INR 3000K-4000KAmazon Web Services | Apache Spark | Cloud platform | Continuous Delivery | Data GovernanceSenior-level Full TimeBangalore, India; Chennai, India; Hyderabad, India; …11h ago
-
Data Engineer, Flex Analytics INR 1500K-2400KAWS Glue | Amazon Kinesis | Amazon Redshift | Amazon Web Services | Data ArchitectureInclusive cultureEntry-level Full TimeHyderabad, Telangana, IND13h ago
-
Business Intelligence Engineer, Flex Analytics INR 2000K-2700KAmazon QuickSight | Amazon Redshift | Data Modeling | Data Visualization | Data pipelineEntry-level Full TimeHyderabad, Telangana, IND13h ago