Technical Lead - Data Engineer
Gurugram, Haryana, India
INR 1500K-2600K (estimate) Senior-level Full Time
Tasks
- Apply CDC merge upsert strategies
- Build medallion architecture data lakes
- Design ETL/ELT pipelines
- Develop denormalized analytics models
- Enforce data governance quality and lineage
- Handle incremental and reconciliation processing
- Implement CI/CD pipelines
- Implement idempotent processing
- Ingest data with batch streaming and event driven patterns
- Ingest enterprise data into Azure data platform
- Integrate data across Microsoft SAP and CRM systems
- Manage metadata and data lineage
- Process data with Spark and PySpark
- Support AI and agent enabled solutions
- Tune and optimize pipeline performance and cost
Perks/Benefits
- N/A
Skills/Tech-stack
Apache Spark | Azure Cosmos | Azure Cosmos DB | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure Data Lake Storage Gen2 | Azure Databricks | Azure DevOps | Azure Event | Azure Event Hubs | Azure Functions | Azure Logic | Azure Logic Apps | Azure SQL | Azure Service | Azure Service Bus | Azure Synapse | Azure Synapse Analytics | CDC | CI/CD | CRM | Cosmos DB | Data Factory | Data Governance | Data Lake Storage Gen2 | Data Lineage | Data Quality | ELT | ETL | Event Hubs | GitHub Actions | Logic Apps | Medallion Architecture | Metadata Management | Microsoft Azure | Microsoft Fabric | PySpark | REST APIs | SAP | Service Bus | Synapse Analytics | Upsert
Education
N/A
Roles
Related jobs
-
Sr Developer Software INR 2000K-4000KAWS | AWS Glue | AWS Lambda | Amazon ECS | Amazon EMRFlexible work environment | Internal mobility | Volunteering opportunities | Well-being | Work-life balanceSenior-level Full TimeKA Bangalore, India10h ago
-
Data Architect INR 1500K-2600KApache Kafka | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageSenior-level Full TimeBangalore North, India18h ago
-
Senior AI/ML Engineer INR 3799K-5572KAI Security | AI Services | AWS | Agentic AI | AirflowAccident Coverage | Career growth | Group term life insurance | Health insurance | Hybrid work supportSenior-level Full TimeIQEQ Hyderabad, Tower 2, 7th floor, … R18h ago
-
AIML Engineer Digital & AI INR 3242K-5000KAWS | Azure | CI/CD | Deep learning | DockerAccident Coverage | Career growth | Group term life insurance | Internet allowance | Medical insuranceSenior-level Full TimeIQEQ Hyderabad, Tower 2, 7th floor, … R19h ago
-
Lead Database Engineer INR 1500K-3000KAudit Logging | Azure Data | Azure Data Factory | Azure Database | Azure Database MigrationSenior-level Full TimePune City, India19h ago
-
ETL,K8, NiFi, Kafka, Prod Support/Senior Consultant Specialist INR 2800K-4200KAIOps | AWS | Agile | Ansible | AzureFlexible working | Professional development opportunitiesSenior-level Full TimeHyderabad, Telangana, India R19h ago
-
Data Scientist INR 2500K-4500KAdvanced Statistics | Apache Spark | Azure Data | Azure Data Factory | Azure KubernetesEquity and inclusion focus | Mentorship opportunities | Travel to other locations in India and globally | Work on global projectsSenior-level Full TimeBangalore - Karnataka - India19h ago
-
Lead AI Engineer - Agentic Engineering INR 2500K-5000KAPI Design | Agent Orchestration | Agent systems | Autogen | Automated RegressionSenior-level Full TimeHyderabad, TS, India19h ago
-
MongoDB, Python, MSA/Consultant Specialist INR 1200K-2000KAWS | Aggregation Pipeline | Azure | CI/CD | Data ModelingContinuous professional development | Flexible working | Inclusive workplace cultureSenior-level Full TimeHyderabad, Telangana, India R19h ago
-
Sr.Data Engineering INR 1500K-2500KAzure Data | Azure Data Factory | Azure Databricks | Azure Event | Azure Event HubsSenior-level Full Timebengaluru, India20h ago
-
DevOps/MLOps Specialist INR 4000K-5500KAnsible | Apache Airflow | Apache Beam | Apache Kafka | CI/CDMid-level Full Timebengaluru, India20h ago
-
Senior-level Full TimePune, Maharashtra, India20h ago
-
Data Ingestion Engineer (ADF+Dbt+Snowflake) INR 1500K-2000KAPI Integration | Azure Data | Azure Data Factory | DBT | Data FactoryMid-level Full TimePune, MH, India20h ago
-
Lead Developer (Python, React, AWS, GenAI) INR 3242K-4800KAgile | Amazon Web Services | Apache Kafka | Continuous integration | DevSecOpsAutonomy | Inclusive & Supportive Culture | Mentoring | Professional development opportunitiesSenior-level Full TimePune, India21h ago
-
Mid-level Full TimeBengaluru, Karnataka, India R21h ago
-
Senior-level Full TimePune, Maharashtra, India21h ago
-
Assistant Manager INR 1500K-2500KAirflow | BigQuery | Cloud Composer | Cloud Dataproc | Cloud StorageMid-level Full TimePune, Maharashtra, India21h ago
-
Mid-level Full TimeChennai, Tamil Nadu, India R22h ago
-
Accountability Models | Analytics | Consent Management | Data Accessibility | Data GovernanceContract opportunity | Exposure to data privacy and analytics initiatives | Fully remote working | High visibility stakeholder engagement | Long term program impactSenior-level Contract Full TimeIndia R22h ago
-
Mid-level Full TimeNoida, Uttar Pradesh, India R22h ago
-
AWS Data Engineer INR 1500K-2500KAWS | AWS Glue | Amazon Athena | Amazon EMR | Amazon S3Hybrid workMid-level Full TimeBengaluru, Karnataka, India R22h ago
-
EAI Software Engineer INR 1800K-2500KAPI Gateway | APIs | Agile | ArgoCD | CI/CDOn site work 4 days per week | Relocation N/AMid-level Full TimeHyderabad, India22h ago
-
Software Engineer III-Java, Kafka/Streams INR 2000K-3000KAgile | Application Resiliency | CI/CD | Data Visualization | JavaSenior-level Full TimeMumbai, Maharashtra, India23h ago
-
Software Engineer II - AI & Agentic Automation INR 1200K-2500KAI Search | AWS | AWS CDK | AWS CloudFormation | AWS environmentsMid-level Full TimeBangalore, Karnataka, India23h ago
-
Mid-level Full TimeHyderabad, India23h ago