Lead Data Engineer - ETL

Gurugram, Haryana, India

INR 2000K-2500K (estimate) Senior-level Full Time

@ S...

Apply Save

Found 1mo ago

Tasks

Build and maintain Operational Data Store ODS
Collaborate on CI/CD pipelines with DevOps
Design and implement ETL/ELT pipelines
Develop denormalized API ready data models
Enforce data governance data quality and metadata management
Implement batch and streaming ingestion with Kinesis or Lambda
Implement idempotent processing CDC merge upsert and reconciliation
Ingest MMS and POS data into AWS platforms
Integrate ODS with microservices via APIs and event streams
Optimize data processing workflows with Apache Spark
Provide technical leadership and mentorship through peer reviews
Store and query data using Amazon S3 and analytics services
Tune pipeline performance for scalability and cost

Perks/Benefits

Skills/Tech-stack

Education

N/A

Roles

Apply Save

Language: en Views: 3

Clicks: 1

Saves: 0

Related jobs

AI Engineer III INR 3715K-5876K

APIs | Agentic AI | BigQuery | CI/CD | Cloud Composer

Senior-level Full Time

Bengaluru, KA, India

7h ago
CDP Specialist (Treasure Data) INR 1500K-2000K

AI machine learning | API Integration | Amazon Web Services | Big Data | Cassandra

Mid-level Full Time

IN-KA-Bangalore

9h ago
Data Engineer - AIML Data modeling INR 1500K-2000K

Airflow | Apache Beam | Apache Spark | Containerization | Elasticsearch

Mid-level Full Time

IN-AP-Hyderabad

9h ago
Data Engineering - AIML Data Modeling - SSE INR 1500K-2000K

Airflow | Apache Beam | Apache Spark | Containerization | Dependency Injection

Mid-level Full Time

IN-AP-Hyderabad

9h ago
Delivery Lead - AI Engineer INR 4000K-5500K

AWS | Apache Spark | Automation | Azure | Cloud platform

Senior-level Full Time

Pune, Maharashtra, India

10h ago
AI Software Engineer INR 1500K-2500K

API Development | AWS | Access Control | Agentic patterns | Auditability

Company bonus/profit share | Flexible work arrangements | Long service awards | Medical benefits | Mobile Phone Reimbursement

Mid-level Full Time

Chennai, India

10h ago
AVP - QA Automation Engineer - IB Tech & CRM/ Analytics INR 3000K-4000K

AWS | AWS Lambda | AWS RDS | Amazon Redshift | Amazon S3

Executive-level Full Time

Pune, India

12h ago
Product Engineering Specialist INR 2500K-5000K

AI Foundry | AI Governance | AI Solution | AI Solution Architecture | AI platforms

Senior-level Full Time

Pune, Maharashtra, India

12h ago
Software Engineer III - Bigdata, Spark, AWS - (Data Engineering) INR 3500K-4720K

AWS | Agile | Apache Spark | Application Resiliency | Automated testing

Senior-level Full Time

Hyderabad, Telangana, India

13h ago
Sr. Technical Analyst INR 3264K-4995K

Angular | CI/CD | Design Patterns | Java | Linux

Senior-level Full Time

Mumbai, India

13h ago
Applied AI ML Associate Senior INR 1200K-2500K

AI Agents | AWS Lambda | AWS Step Functions | Agentic AI | Amazon Athena

Mid-level Full Time

Hyderabad, Telangana, India

14h ago
D&T Lead - Data Science INR 3000K-5000K

Agentic AI | AlloyDB | Apache Airflow | Artificial Intelligence | CI/CD

Senior-level Full Time

Pune, IN

15h ago
DE&A - Core - Cloud Data Engineering - AWS Data Engineering INR 3000K-4000K

AWS | AWS Data | AWS Data Governance | AWS EC2 | Data Governance

Senior-level Full Time

Pune, Maharashtra, India

15h ago
Intermediate Backend Engineer - Analytics Instrumentation INR 2000K-3370K

At-Scale | Backend Development | ClickHouse | Cloud Native | Data Quality

Equity compensation | Flexible paid time off | Growth and development fund | Parental leave | Remote work

Mid-level Full Time

Remote, India R

15h ago
Software Engineer I INR 2500K-4800K

A/B | A/B Testing | API Design | AWS | Airflow

Senior-level Full Time

Bengaluru, Karnataka, India

15h ago
Apprentice INR 300K-400K

API | Automation | Data Quality | Generative AI | Language Models

Career development opportunities | Structured training

Entry-level Apprenticeship Full Time

Gurugram, HR, India

16h ago
Senior Data Quality Engineer (ETL Testing) INR 2000K-3000K

AWS Glue | AWS Lambda | AWS Step Functions | Agile | Amazon Athena

Contract-to-hire | Remote work

Senior-level Full Time

Bangalore, India

16h ago
Senior Applied AI Engineer A INR 2500K-4200K

API Design | AWS | Amazon SageMaker | Automated retraining | CI/CD

Autonomy and ownership | Continuous learning | Fully remote | High-growth environment | Professional development

Senior-level Full Time

India R

17h ago
Manager Data Integration INR 2520K-4064K

Apache Airflow | BigQuery | Bigtable | Celigo | Cloud Composer

Senior-level Full Time

Bengaluru, KA, India

18h ago
Python with ADB INR 1500K-2000K

API Testing | Agile | Azure | Azure DevOps | CI/CD

Career growth programs | Flexible work hours | Generative AI Certifications Support | Remote work | Work-life balance

Mid-level Full Time

Hyderabad, IN

22h ago
AI Engineer INR 2500K-4580K

API Integration | Authentication | Authorization | CI/CD | Docker

Senior-level Full Time

Bangalore, KA, IN

22h ago
Senior Data Engineer INR 3200K-4200K

AWS | Airflow | Apache Spark | CI/CD | Cloud Computing

Company-matched student loan contribution | Continuous learning resources | Family-friendly perks | Financial wellness programs | Flexible time off

Senior-level Full Time

IN - HYDERABAD SKYVIEW, India

22h ago
Databricks Solution Architect INR 2000K-3000K

AWS | Azure | CI/CD | CloudWatch | Data Governance

On-site client work | Remote work flexibility

Senior-level Full Time

India - Remote R

22h ago
Senior Consultant (Databricks) INR 2000K-2800K

Amazon Web Services | Apache Airflow | Apache Spark | Azure | Azure Data

Senior-level Full Time

India - Remote R

22h ago
Software Development Senior Analyst INR 2000K-4500K

API Gateway | AWS CloudFormation | AWS Lambda | Agile | Amazon Bedrock

Senior-level Full Time

Chennai, TN, IN

22h ago

Lead Data Engineer - ETL

Tasks

Perks/Benefits

Skills/Tech-stack

Education

Roles

Regions

Countries

States

Cities

Related jobs