Lead / Staff Data Engineer - Data Platform
INR 2200K-3500K (estimate) Senior-level Full Time
Tasks
- Build and optimize analytical query workloads
- Build batch and near real time data pipelines
- Create data models and data marts
- Design data platform architecture
- Develop lakehouse using Apache Hudi
- Implement data reliability observability SLAs lineage and quality checks
- Maintain Apache Airflow orchestration
- Mentor data engineers and influence architecture decisions
- Optimize storage compute query performance and pipeline costs
- Own ETL ELT pipeline reliability and debugging
- Set standards for schema evolution partitioning deduplication and backfills
Perks/Benefits
- N/A
Skills/Tech-stack
Apache Airflow | Apache Hudi | Clustering | Compaction | Data Lake | Data Lineage | Data Modeling | Data Quality | Data Reliability | Data Warehouse | Deduplication | Deletes | Distributed Computing | Distributed Query Engine | Distributed query | ELT | ETL | Incremental Reads | Java | Lakehouse | Observability | Partitioning | Presto | Python | Query engine | SQL | Scala | Schema evolution | Timeline and Commits | Trino | Upserts
Education
N/A
Roles
Data Engineer | Engineer | Lead | Lead Data | Lead Data Engineer | Staff Data Engineer
Related jobs
-
Lead AI/ML Engineer – Security AI & LLMs INR 3000K-5000KAPI Design | AWS SageMaker | Azure ML | Deep learning | DockerSenior-level Full TimePune, Maharashtra, India2h ago
-
Senior-level Full TimeMitratech India3h ago
-
Genetics Data Engineer 1 INR 3000K-4600KAPI Development | AWS | Agentic AI | Azure | BcftoolsCareer development opportunities | Flexible work culture | Inclusive workplaceSenior-level Full TimeBangalore, Karnataka, IN, 5600373h ago
-
Senior-level Full TimeHyderabad4h ago
-
Tech Lead - Java (Java, React, Kong) INR 1500K-3000KAPI Development | API Gateway | API Management | API Security | AgileSenior-level Full TimePune, IN, 4110574h ago
-
Senior-level Full TimeHyderabad, IN, 5000814h ago
-
Senior AI Engineer INR 2500K-5000KA2A | AI Foundry | AI Search | AI guardrailing | Agent architectureCollaboration | Documentation | Startup mindsetSenior-level Full TimeHyderabad4h ago
-
Azure Databricks | Azure DevOps | Data Quality | Data Warehousing | DatabricksCollaborative Agile environment | Fully remote | Hands on cloud data platform exposureMid-level Full TimeIndia R5h ago
-
Data Analytics/Engineer (Python and MS Fabric exp) INR 2500K-4720KAWS | Apache Airflow | Azure Data | Azure Data Factory | Azure SynapseCross-functional collaboration | Mentorship | Professional developmentSenior-level Full TimeIND-Pune-Smartworks, India9h ago
-
AWS S3 | Amazon Redshift | Amazon Web Services | Apache Spark | Azure DataSenior-level Full TimeBengaluru Millenia, India9h ago
-
API | Agentic AI | Anthropic | Bagging | BoostingFlexibility programmes | Hybrid work | Inclusive benefits | Mentorship | Wellbeing supportSenior-level Full TimeNoida, India9h ago
-
Technical Lead-Azure Databricks INR 1500K-2700KAzure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure Data Lake Storage Gen2Senior-level Full TimeINDIA - BENGALURU - HP, IN9h ago
-
Software Engineer - Python Expert, API Frameworks, RAG, Gen AI, Devops, Frontend Frameworks (5+ Years) INR 2500K-5000KAgentic AI | Alerting | Angular | CI/CD | Cause analysisSenior-level Full TimeIND-BANGALORE, India9h ago
-
AI Assisted Development | Claude Code | Code review | Cursor | JavaScriptFlexible hours | Ongoing project based workSenior-level Full TimeMiami18h ago
-
AWS | Autogen | Azure | BERT | Computer VisionCollaborative team environment | Continuous learning | Professional growthMid-level Full TimeIndia19h ago
-
Member of Technical Staff - AI/ML Engineer INR 2500K-4500KAnomaly Detection | BM25 | Computer Vision | Document Understanding | Entity ResolutionEquity | Professional developmentSenior-level Full TimeHyderabad, TS, IN19h ago
-
Machine Learning Engineer - IV (Computer Vision) INR 1000K-1800KANN search | Airflow | Approximate Nearest Neighbor | CoreML | Data IngestionMid-level Full TimeIndia (remote) R19h ago
-
AI-Native Software Developer INR 2500K-4000K.NET | AI Evaluation | AI Orchestration Framework | AI guardrails | AI orchestrationMid-level Full TimeBangalore - Karnataka - India20h ago
-
Senior-level Full TimeMaharashtra, Pune, India20h ago
-
Software Engineer, BizTech(Python, LLM, GenAI, MCP) INR 2380K-3400KAI Agents | AI Assisted Development | API Design | AWS | ClaudeMid-level Full TimeBangalore, India21h ago
-
Mid-level Full TimeIN-AP-Hyderabad21h ago
-
Senior-level Full TimeIN-AP-Hyderabad21h ago
-
Senior-level Full TimeIN-AP-Hyderabad21h ago
-
Senior-level Full TimeIN-AP-Hyderabad21h ago
-
Senior-level Full TimeIN-TN-Chennai21h ago