Lead Data Engineer
Tasks
- Build and operate ML feature pipelines
- Define testable version controlled pipelines with DLT
- Design build maintain data pipelines
- Design feature stores and streaming feature infrastructure
- Develop model-serving pipelines
- Ingest data into BigQuery
- Mentor junior engineers
- Monitor alert error handling and incident response
- Optimize performance reliability and developer velocity
- Validate schema design and data quality standards
Perks/Benefits
Skills/Tech-stack
Airflow | Alerting | BigQuery | CI/CD | CloudFormation | DBT | DLT | Data Governance | Data Quality | Dataflow | ELT | Event Streaming | GCP | Great Expectations | Infrastructure as Code | Kafka | Monitoring | Observability | Orchestration | Pub/Sub | Pulumi | Python | Redshift | SQL | Snowflake | Terraform | Version control | “as-code”
Education
N/A
Roles
Data Engineer | Engineer | Lead | Lead Data | Lead Data Engineer
Related jobs
-
Data Engineer - People Data, Insights & Analytics INR 1500K-2000KAWS | Apache Spark | Azure | CI/CD | Data ModelingMid-level Full TimePune, Maharashtra, India13h ago
-
Mid-level Full TimeBengaluru17h ago
-
Senior-level Full Timecoimbatore, India18h ago
-
Python Engineer (AI/ML) INR 2500K-3500KCPU | Chroma | Cost Optimization | Data Preprocessing | DockerMid-level Full TimePune, MH, India20h ago
-
Data Analytics AI Specialist INR 15K-20KClassification | Clustering | Data Visualization | Data cleaning | Machine LearningFast-paced startup environment | Growth opportunities | High ownershipEntry-level Full TimeGurugram, HR, IN20h ago
-
Senior-level Full TimePune City, India20h ago
-
Senior-level Full TimeIN-KA-Bangalore22h ago
-
Gen AI Developer INR 2000K-4500KData Engineering | Distributed Systems | GenAI | Language Models | Large Language ModelsSenior-level Full TimeIN-TN-Chennai22h ago
-
Senior-level Full TimeIN-TN-Chennai22h ago
-
Senior-level Full TimeIN-TN-Chennai22h ago
-
Senior-level Full TimeIN-TN-Chennai22h ago
-
Software Engineer - Azure Data engineer INR 3000K-3500KAccess Control | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageCollaborative work environment | In-office 5 days | Professional development | Recognition and rewards | Training opportunitiesSenior-level Full TimeBangalore - Karnataka, India - Kalyani …22h ago
-
Lead Data Engineer - Data Archival - Bangalore INR 1500K-2500KApache Spark | Data Warehousing | ETL | Hadoop | JavaSenior-level Full TimeIndia22h ago
-
Senior-level Full TimePune, Maharashtra, India23h ago
-
Mid-level Full TimeHyderabad, India23h ago
-
Sr Principal Data Scientist INR 3000K-4000KAgentic AI | Causal Inference | Causal ML | Contextual Bandits | DatabricksSenior-level Full TimeBangalore, INDIA R23h ago
-
Azure Infra AI Operations & Platform Engineer INR 2000K-4500KAI Foundry | AKS | API Integration | Azure | Azure AIMid-level Full Timebangalore, India23h ago
-
Quantum AI Research Engineer INR 180K-240KAI Agents | Artificial Intelligence | Data Analysis | Deep learning | Generative AIEntry-level Full Timebengaluru, India1d ago
-
Global HR Reporting and Analytics Lead (HR/Workday reporting) INR 3000K-4000KBI Analytics | Data Architecture | Data Governance | Data Quality | Data Quality ManagementSenior-level Full TimeDelhi, India1d ago
-
Data Engineer — Recommendation Engine INR 1500K-2200KAWS Glue | Airflow | Amazon ECS | Amazon S3 | Cache invalidationMid-level Full TimeHaryana, Gurugram, India1d ago
-
Agentic Data Delivery Lead INR 2000K-4500KAWS | Access Control | Agent systems | Apache Hadoop | Apache SparkSenior-level Full TimePune, Maharashtra, India1d ago
-
Agentic / GEN AI INR 2000K-4500KAI Services | Agentic AI | Azure AI | Azure AI Services | Azure DatabricksSenior-level Full TimeNoida, Uttar Pradesh, India1d ago
-
Machine Learning Engineer (Remote) INR 2500K-4500KAutomated testing | CI/CD | Git | Machine Learning | NumPyRemote work | Scrum team collaborationSenior-level Full TimeMaharashtra, Pune, India R1d ago
-
GenAI LLM Python/Sr. Associate Director, Software Engineering INR 1500K-2500KAgent Orchestration | Agent systems | Amazon Web Services | Cloud platform | ComplianceFlexible workingMid-level Full TimePune, Maharashtra, India R1d ago
-
Senior Data Engineer INR 3000K-4000KAWS | Amazon Aurora | Apache Spark | Azure | Batch ProcessingAccreditations | Bike to work | Educational assistance | Employee assistance program | Employee discountSenior-level Full TimeMumbai, MH, India1d ago