Big Data Lead

India

INR 1500K-2500K (estimate) Senior-level Full Time

@ H...

Apply Save

Found 1d ago

Tasks

Apply AWS best practices for data storage and security
Automate ETL processes
Build data pipelines
Export and import data
Generate code using Python and Jinja templates
Implement CI/CD using GitHub
Implement dbt tests for data validation
Monitor pipeline runs and reprocess error records
Optimize SQL queries for performance
Orchestrate pipelines in sequence or parallel
Schedule data workflows with Airflow
Troubleshoot data pipeline errors
Write Python unit integration and system tests

Perks/Benefits

Skills/Tech-stack

Education

N/A

Roles

Regions

Asia/Pacific

Countries

India

Apply Save

Language: en Views: 1

Clicks: 0

Saves: 0

Related jobs

Lead AI/ML Engineer – Security AI & LLMs INR 3000K-5000K

API Design | AWS SageMaker | Azure ML | Deep learning | Docker

Senior-level Full Time

Pune, Maharashtra, India

4h ago
Principal Data Engineer INR 3242K-4800K

AWS | Airbyte | CI/CD | DBT | Data Governance

Senior-level Full Time

Mitratech India

5h ago
Genetics Data Engineer 1 INR 3000K-4600K

API Development | AWS | Agentic AI | Azure | Bcftools

Career development opportunities | Flexible work culture | Inclusive workplace

Senior-level Full Time

Bangalore, Karnataka, IN, 560037

5h ago
Senior AI Engineer INR 2500K-5000K

A2A | AI Foundry | AI Search | Agentic AI | Azure AI

Senior-level Full Time

Hyderabad

6h ago
Node JS Developer - Senior Consultant INR 2200K-3500K

AWS OpenSearch | Agile | Apache Kafka | Bull queue | CI/CD

Senior-level Full Time

Bangalore, IN, 560066

6h ago
Tech Lead - Java (Java, React, Kong) INR 1500K-3000K

API Development | API Gateway | API Management | API Security | Agile

Senior-level Full Time

Pune, IN, 411057

6h ago
AIML Engineer INR 2500K-5000K

API | Agentic architecture | Azure | Azure OpenAI | Backend Services

Senior-level Full Time

Hyderabad, IN, 500081

6h ago
Senior AI Engineer INR 2500K-5000K

A2A | AI Foundry | AI Search | AI guardrailing | Agent architecture

Collaboration | Documentation | Startup mindset

Senior-level Full Time

Hyderabad

6h ago
Databricks Tester, Contract A INR 1500K-2500K

Azure Databricks | Azure DevOps | Data Quality | Data Warehousing | Databricks

Collaborative Agile environment | Fully remote | Hands on cloud data platform exposure

Mid-level Full Time

India R

7h ago
Data Analytics/Engineer (Python and MS Fabric exp) INR 2500K-4720K

AWS | Apache Airflow | Azure Data | Azure Data Factory | Azure Synapse

Cross-functional collaboration | Mentorship | Professional development

Senior-level Full Time

IND-Pune-Smartworks, India

11h ago
IN-Senior Associate_ Data Engineering__ Data & Analytics _ Advisory _Bangalore INR 2500K-4000K

AWS S3 | Amazon Redshift | Amazon Web Services | Apache Spark | Azure Data

Senior-level Full Time

Bengaluru Millenia, India

11h ago
IN_Senior Associate_Data Scientist Gen AI_Data & Analytics_Advisory_Noida INR 2000K-5000K

API | Agentic AI | Anthropic | Bagging | Boosting

Flexibility programmes | Hybrid work | Inclusive benefits | Mentorship | Wellbeing support

Senior-level Full Time

Noida, India

11h ago
Technical Lead-Azure Databricks INR 1500K-2700K

Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure Data Lake Storage Gen2

Senior-level Full Time

INDIA - BENGALURU - HP, IN

11h ago
Software Engineer - Python Expert, API Frameworks, RAG, Gen AI, Devops, Frontend Frameworks (5+ Years) INR 2500K-5000K

Agentic AI | Alerting | Angular | CI/CD | Cause analysis

Senior-level Full Time

IND-BANGALORE, India

11h ago
Snowflake Data Engineer INR 2000K-2600K

Amazon Web Services | Apache Spark | Bitbucket | CI/CD | Cloud platform

Senior-level Full Time

Bangalore, KA, IN

11h ago
Snowflake Data Engineer INR 2000K-2600K

AWS | Apache Hadoop | Apache Spark | Azure | Bitbucket

Senior-level Full Time

Bangalore, KA, IN

11h ago
Snowflake Data Engineer INR 2000K-2600K

AWS | Apache Spark | Azure | CI/CD | DBT

Senior-level Full Time

Bangalore, KA, IN

11h ago
AWS / Kafka / Airflow INR 2040K-3380K

AWS | Amazon EC2 | Amazon EKS | Amazon MSK | Amazon MWAA

Senior-level Full Time

Bengaluru, KA, IN

11h ago
EY - GDS Consulting - AI And DATA - Databricks - Senior INR 2400K-4000K

API | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage

Senior-level Full Time

Trivandrum, KL, IN, 695581

11h ago
TTT-.NET-Angular-Full Stack with Gen AI-Staff INR 2000K-3500K

.NET | AI Agent | AI Agent Frameworks | AI Search | Agent Framework

Senior-level Full Time

Kolkata, WB, IN, 700091

11h ago
TTT - .NET - Angular-Full Stack with Gen AI - Senior INR 2000K-4500K

.NET | AI Foundry | AI Search | App Service | Azure AI

Senior-level Full Time

Kolkata, WB, IN, 700091

11h ago
AI Interaction Evaluator (Codex / Claude Code, up to $200/hr) USD 100K-400K

AI Assisted Development | Claude Code | Code review | Cursor | JavaScript

Flexible hours | Ongoing project based work

Senior-level Full Time

Miami

20h ago
Data Scientist A INR 1100K-2500K

AWS | Autogen | Azure | BERT | Computer Vision

Collaborative team environment | Continuous learning | Professional growth

Mid-level Full Time

India

21h ago
Member of Technical Staff - AI/ML Engineer INR 2500K-4500K

Anomaly Detection | BM25 | Computer Vision | Document Understanding | Entity Resolution

Equity | Professional development

Senior-level Full Time

Hyderabad, TS, IN

21h ago
Machine Learning Engineer - IV (Computer Vision) INR 1000K-1800K

ANN search | Airflow | Approximate Nearest Neighbor | CoreML | Data Ingestion

Mid-level Full Time

India (remote) R

21h ago