Big Data Lead

India

INR 1500K-2000K (estimate) Senior-level Full Time

@ H...

Apply Save

Found 21d ago

Tasks

Build ETL/ELT pipelines
Build streaming data pipelines
Collaborate on master data management and metadata
Design data ingestion pipelines
Develop data models
Document data sources transformations and runbooks
Implement CDC micro batch processing
Implement automated testing
Implement compliant access with RBAC and ABAC
Implement data quality checks
Implement security and privacy controls like masking and tokenization
Lead complex integrations and migrations
Lead project execution and cross team alignment
Optimize storage and compute cost
Set up observability lineage metrics and alerts
Write SQL and Python transformations

Perks/Benefits

Skills/Tech-stack

Education

Bachelor of Science

Roles

Regions

Asia/Pacific

Countries

India

Apply Save

Language: en Views:

1 Clicks:

2 Saves: 0

Related jobs

Senior AI Engineer - Remote INR 3375K-5000K

AWS DocumentDB | Apache Tomcat | CI/CD | CircleCI | CloudFormation

Flexible distributed team | Remote work

Senior-level Full Time

Bengaluru, KA, India R

14h ago
Principal Data Engineer / Associate Director Software Engineering INR 800K-2000K

Apache Beam | Apache Flink | Apache Kafka | Apache Spark | Data Processing

Mid-level Full Time

Pune, Maharashtra, India R

20h ago
AI Engineer INR 3000K-5000K

API Development | Agent Development | Agent Development Framework | Agent Development Kit | Anthropic

Mid-level Full Time

Pune, Maharashtra, India

21h ago
Jr Data Engineer INR 360K-420K

AWS Glue | Apache Airflow | Apache Flink | Apache Kafka | Apache Spark

Entry-level Full Time

Bangalore North, India

21h ago
Senior Databricks Data Engineer INR 2000K-2500K

AWS | Apache Kafka | Apache Spark | Azure | CI/CD

Senior-level Full Time

Bangalore, IN

21h ago
Senior Software Engineer INR 1632K-2500K

APIs | DAX | Data Modeling | ETL | Excel

Senior-level Full Time

IN-KA-Bangalore

22h ago
Senior Consultant INR 2000K-2700K

Azure Data | Azure Data Lake | Azure Databricks | Azure Machine Learning | Data Lake

Senior-level Full Time

IN-KA-Bangalore

22h ago
Apprentice-IT INR 360K-562K

API | Data Architecture | Data Governance | Data Modeling | Data Quality

Entry-level Apprenticeship

Pune, Maharashtra, IND, 411014

22h ago
Monitoring-Operations Support-Analytics and Reporting INR 938K-1300K

AWS | Excel | ITIL | Incident Management | Microsoft PowerPoint

Flexible hours

Entry-level Full Time

Hyderabad, Telangana, India

23h ago
DE&A - AI Engineer INR 2000K-3300K

AI Evaluation | API Keys | AWS | Agent SDK | Agent systems

Mid-level Full Time

Bangalore, Karnataka, India

1d ago
DE&A - AI Engineer INR 2000K-3300K

API Keys | AWS | Agent systems | Agentic Workflows | Anthropic API

Mid-level Full Time

Bangalore, Karnataka, India

1d ago
DE&A - AI Engineer INR 3000K-4000K

API Keys | AWS | Agent SDK | Agent systems | Agentic Workflows

Mid-level Full Time

Bangalore, Karnataka, India

1d ago
AI Data Engineer III INR 3000K-4000K

AWS | Agile | Apache Airflow | CI/CD | DBT

Continuous learning | Generous leave policies | Health insurance | Hybrid work policies | Wellness programs

Senior-level Full Time

Bengaluru, Karnataka, India

1d ago
Senior Production Support Engineer - LoanIQ - Bangalore INR 3000K-5000K

APIs | Automation | Cause analysis | Incident Management | Java

Senior-level Full Time

India

1d ago
Assistant Manager-KDNI INR 1500K-2000K

Agile | Apache Spark | Azure | Azure Data | Azure Data Factory

Mid-level Full Time

Hyderabad, Telangana, India

1d ago
Data Delivery lead/ Associate Director, Data and Analytics INR 650K-1100K

AI Observability | AI frameworks | Agentic AI | Agentic AI Frameworks | Agile

Mid-level Full Time

Hyderabad, Telangana, India R

1d ago
Senior Consultant Specialist INR 3000K-5500K

AWS | Apache Spark | Artificial Intelligence | Cloud platform | Data Analysis

Senior-level Full Time

Bangalore, Karnataka, India R

1d ago
Associate Director, Data and Analytics INR 2000K-3000K

AIOps | AWS | Adversarial Attacks | Agentic Systems | Bias detection

Mid-level Full Time

Bangalore, Karnataka, India

1d ago
Senior Data Systems Software Engineer INR 3264K-5572K

API Integration | APIs | Agentic AI | C# | C++

Senior-level Full Time

BENGALURU, KARNATAKA, India

1d ago
Engineer - Embedded Automation QA INR 480K-1050K

API Testing | Agile | Automation Framework | Azure DevOps | BACnet

Mid-level Full Time

Hadapsar, Pune, Maharashtra, IND, 411013

1d ago
Software Engineer I- Eng INR 300K-350K

AWS | Agile | Automation | CI/CD | Cloud Computing

Flexible work arrangements | Health benefits | Mentorship | Paid time off

Entry-level Full Time

Noida,UP,India R

1d ago
ML Associate Engineer INR 1800K-2700K

AWS | Agile | Algorithms | Azure | Big Data

Mid-level Full Time

Hadapsar, Pune, Maharashtra, IND, 411013

1d ago
Senior Data Engineer (Remote, Contractual) [TH003] A INR 1500K-3000K

AWS DMS | Amazon Bedrock | Amazon Kinesis | Amazon QuickSight | Amazon SageMaker

Flexible shifts | Long-term career growth | Mentorship and community | No weekend work | Remote work

Senior-level Contract Full Time

Delhi R

1d ago
Senior Data & Analytics Engineer INR 3000K-4000K

AWS | Apache Spark | Azure | CI/CD | Cloud platform

Senior-level Full Time

Bangalore, Karnataka, IN

1d ago
Senior AVP Enterprise Digital - Lead Data Management INR 2000K-4000K

Alerting | Apache Spark | Azure Data | Azure Data Factory | Azure Data Lake

Senior-level Full Time

Noida, Uttar Pradesh, India

1d ago