Lead Data Engineer
Pune, Maharashtra, India
INR 1500K-2500K (estimate) Senior-level Full Time
Tasks
- Automate manual processes
- Build data pipelines
- Design and implement distributed data processing
- Implement data governance and lineage
- Integrate data services with client products and external vendors
- Lead technical discussions and guide team members
- Monitor data quality and observability
- Support production environment operations
- Troubleshoot production issues and perform root cause analysis
- Write unit and integration tests
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | Airflow | Atlan | DBT | Dagster | Databricks | Git | Hadoop | Hive | Jenkins | Jira | PySpark | Python | SQL | Shell Scripting | Snowflake | Spark | Trino
Education
Roles
Data Engineer | Engineer | Lead | Lead Data | Lead Data Engineer
Related jobs
-
Senior-level Full TimePune City, India4h ago
-
AI Engineer – Reliability & Warranty Analytics INR 1800K-3000KBacktesting | BigQuery | CI/CD | Calibration | Cloud RunMid-level Full TimeChennai, Tamil Nadu, India5h ago
-
Associate III Business Intelligence-SUPPORT SERVICES-Data & Analytics - In House Engineering INR 800K-1800KBig Data | Big data concepts | C++ | Data Visualization | Data conceptsMid-level Full TimeBangalore, Karnataka, India6h ago
-
AI Engineer – Retail/CPG Domain INR 1800K-2500KAWS | Azure | Data Governance | Data Modeling | Data SecurityMid-level Full TimeGurugram, Haryana, India7h ago
-
Associate Principal Engineer (India Office) INR 1500K-2000KADLS | Azure Data | Azure Data Factory | Azure DevOps | CDCMid-level Full TimeBangalore, Karnataka, India8h ago
-
Senior-level Full TimeChennai, Tamil Nadu, India9h ago
-
Applied AI ML Lead INR 2500K-4800KAI Agents | AWS Lambda | AWS S3 | AWS Step Functions | Agentic AISenior-level Full TimeHyderabad, Telangana, India9h ago
-
Agentic AI | Agile | DAX | Data Governance | Data ModelingSenior-level Full TimeBengaluru, Karnataka, India9h ago
-
Lead Software Engineer - Java/Python, LLM, AWS INR 3000K-5000KA/B | A/B Testing | AWS | Agile | Amazon AuroraSenior-level Full TimeBengaluru, Karnataka, India9h ago
-
Platform Engineering Professional - Data Engineer INR 2200K-3500KAWS | Amazon Kinesis | Apache NiFi | Apache Spark | CI/CDMid-level Full TimeBengaluru, IN, 5601039h ago
-
AWS Data Engineer INR 1500K-6000KAWS | Automation | Cloud Architecture | Data Governance | Data IngestionExecutive-level Full TimeHyderabad, Telangana, India9h ago
-
Senior-level Full TimeHyderabad, TG, India10h ago
-
Senior-level Full TimeNoida, Uttar Pradesh, India11h ago
-
FastAPI | Flask | GIS | Git | MultiprocessingMid-level Full TimeNoida, Uttar Pradesh, India12h ago
-
SDET- India (Chennai/Bangalore) INR 1500K-2000KAWS S3 | Apache Airflow | Apache Superset | BDD | Big DataMid-level Full TimeIndia12h ago
-
Amazon Web Services | Cloud platform | Data Modeling | Databricks | Distributed SystemsBroadband reimbursement | Continuous learning support | Global enterprise client exposure | Health insurance | Paid certificationsSenior-level Full TimeIndia13h ago
-
Bash | Data Processing | Docker | GCP | Large Scale DataAsynchronous culture | Career growth opportunities | Entrepreneurial-minded team | Friendly relaxed atmosphere | Remote/distributed workMid-level Full TimeBangalore, India13h ago
-
Analytics Engineer - Associate INR 1800K-2800KAirflow | Alerting | Azure Data | Azure Data Factory | DagsterSenior-level Full TimeBengaluru, Karnataka, India13h ago
-
Bash | Data Ingestion | Data Processing | Docker | GCPAsynchronous culture | Competitive compensation | Flexible management | Friendly atmosphereMid-level Full TimeMumbai, India13h ago
-
Bash | Cloud platform | Data Processing | Docker | Google CloudMid-level Full TimeNoida, India13h ago
-
Bash | Data Processing | Docker | GCP | Infrastructure as CodeAsynchronous culture | Friendly work environment | Impactful product | Professional development opportunitiesMid-level Full TimeAhmedabad, India13h ago
-
Software Engineer III - AI/ML, Prompt Engineer INR 2475K-4132KA/B | A/B Testing | API Integration | B testing | Chain-of-ThoughtSenior-level Full TimeMumbai, Maharashtra, India13h ago
-
Sr SW Engineer, Machine Learning INR 2475K-3380KA/B Testing | Airflow | Amazon EMR | Amazon S3 | Apache KafkaCommuter benefits | Disability insurance | Financial wellness support | Healthcare (Medical Dental Vision) | Hybrid work scheduleSenior-level Full TimeBengaluru, India14h ago
-
Mid-level Full TimeBengaluru, Karnataka, India18h ago
-
EY - GDS Consulting - AIA - Agentic AI Engineer - Manager INR 1850K-3300KAWS | Async | Autogen | Azure | CelonisContinuous learning | Diverse and inclusive culture | Transformative leadershipMid-level Full TimeKolkata, WB, IN, 70009118h ago