Lead Data Engineer
Tasks
- Architect AI platforms at scale
- Collaborate with security DevOps architecture stakeholders
- Design semantic model and testing practices
- Drive platform monitoring observability and incident response
- Guide data engineering team through mentoring and reviews
- Implement CI CD and production readiness
- Improve platform cost performance and reliability
- Lead Lakehouse and BI semantic layer delivery
- Manage Infrastructure as Code with Terraform and Kubernetes
- Own Azure data platform architecture end to end
- Set standards for data modeling and PySpark quality
Perks/Benefits
Skills/Tech-stack
AAS | ADLS Gen2 | AI Foundry | Access Management | Ansible | Azure AI | Azure AI Foundry | Azure Databricks | Azure Networking | CI/CD | Claude | Cost governance | DAX | Data Contracts | Data Governance | Data Lineage | Data Modeling | Databricks Mosaic | Databricks Mosaic AI | Delta Lake | Docker | FinOps | Git | GitHub | Helm | Identity and Access Management | Identity and access | Infrastructure as Code | Kubernetes | Microsoft Fabric | Monitoring | Mosaic AI | Observability | Power BI | PySpark | Python | RLS | SQL | SSAS | Terraform | Unity Catalog | “as-code”
Education
Roles
Architect | Data Engineer | Data Platform | Data Platform Architect | Engineer | Lead | Lead Data | Lead Data Engineer | Platform Architect
Related jobs
-
Mid-level Full TimeBengaluru, Pune5h ago
-
Data Science Chief Expert - Finance INR 3000K-4000KAWS | Azure | Cloud platform | Cypher | Data PreprocessingExecutive-level Full TimeBangalore, IN, 56006611h ago
-
Data Science Leader - Finance INR 2876K-5000KAgent Orchestration | Agent systems | Data Engineering | Data Modeling | Deep learningConstant learning | Flexible working models | Great benefits | Health and well-being programs | Skill growthSenior-level Full TimeBangalore, IN, 56006611h ago
-
IN_Manager_Agentic + Gen AI__ AI 50_ Advisory_Hyderabad INR 1000K-2500KAgentic AI | C plus plus | C# | CI/CD | DspyFlexibility programmes | MentorshipMid-level Full TimeHyderabad - Salarpuria, India11h ago
-
Sr Technical Lead-BI INR 1500K-3000KAgile | BI Data modeling | DAX | Data Modeling | Data WarehousingSenior-level Full TimeINDIA - PUNE - BIRLASOFT OFFICE …11h ago
-
Senior-level Full TimeINDIA - PUNE - BIRLASOFT OFFICE …11h ago
-
Technical Lead-BI INR 1500K-2700KDAX | Data Modeling | Data Warehousing | Dimensional Modeling | ETLSenior-level Full TimeINDIA - PUNE - BIRLASOFT OFFICE …11h ago
-
Senior-level Full TimeINDIA - PUNE - BIRLASOFT OFFICE …11h ago
-
IN_Sr Associate_Java Full Stack Engineer_D&A_Advisory_Bangalore INR 1200K-2500KAngular | Apache Kafka | App Service | Azure | Azure AppFlexibility programmes | Inclusive benefits | Mentorship | Wellbeing supportSenior-level Full TimeBengaluru Millenia, India11h ago
-
IN_Senior Associate_ Data Scientist_D&A_Advisory_Bangalore INR 3000K-4000KBig Data | Causal Inference | Data Manipulation | Data Modeling | Data VisualizationSenior-level Full TimeBengaluru Millenia, India11h ago
-
Access Control | Anomaly Detection | CI/CD | Classification | Deep learningCollaborative stakeholder environment | Hands on AI engineering | Health and governance focused projects | Remote working modelSenior-level Full TimeIndia18h ago
-
Lead Data Solutions Architect INR 3000K-4500KACID | AWS | AWS Glue | AgentOps | CI/CDHybrid work environmentSenior-level Full TimePune, Maharashtra, India18h ago
-
Backend Developer (Node.js) - GGS - BLR INR 1500K-3000KAPM | Bash | Data Engineering | Debugging | GitFull-time job | Hybrid workMid-level Full TimeKarnataka, Bengaluru, India20h ago
-
Python AI Engineer INR 360K-420KAI Agents | API Integration | Analytics | Cloud services | Computer VisionEntry-level Full TimeKarnataka, Bengaluru, India21h ago
-
Junior AI Specialist INR 300K-420KAWS | Apache Airflow | DBT | Data Modeling | Deep learningCertification programs | Health insurance | Language courses | Mentorship | Professional developmentEntry-level Full TimePune, India R21h ago
-
AI Engineer INR 3264K-5876KApp Service | Async Programming | Azure App | Azure App Service | Azure FunctionsEntry-level Full TimeBangalore, India; Hyderbad, India22h ago
-
Data Science Architect INR 3200K-5000KAgentic AI | Amazon Redshift | Apache Hive | Apache Spark | AutomlFlexible work environment | Mentorship | Professional growthSenior-level Full TimeIndia22h ago
-
Sr. AI Engineer INR 3740K-6612KA2A protocols | AI Security | Agent runtime | Agent systems | App ServiceSenior-level Full TimeBangalore, India; Hyderbad, India22h ago
-
Advanced Engineer, Embedded Software INR 1600K-2500KBitbake | C# | C++ | Embedded Linux | GTestCampus fitness center access | Employee discounts | Flexible hybrid work environment | Training opportunities | Tuition reimbursementMid-level Full TimeIN Bangalore Sattva Knowledge Court Bdg …22h ago
-
GenAI Engineer INR 1860K-3000KAWS | Agent systems | Agentic AI | Amazon Elastic Kubernetes Service | Artificial neural networksMid-level Full TimeNoida, Uttar Pradesh, India23h ago
-
Data Architect - R01570398 INR 1500K-3000KAI Lifecycle | AI Lifecycle Management | ARIMA | ARIMAX | BentoMLSenior-level Full TimeBangalore, Karnataka, India1d ago
-
Senior Software Development Engineer INR 2500K-4000KAgile | Artificial Intelligence | CI/CD | Data Engineering | Data LakeSenior-level Full TimeIndia1d ago
-
GenAI Engineer INR 1860K-3000KAWS | Agent systems | Agentic AI | Apache Spark | Artificial neural networksMid-level Full TimeNoida, Uttar Pradesh, India1d ago
-
Qualtrics/Tableau - Analytics - Associate INR 4000K-4000KAgile | CI/CD | Dashboard governance | Data Modeling | Data pipelineExecutive-level Full TimeBengaluru, Karnataka, India1d ago
-
Data Engineer Intern - Gurugram INR 600KBatch Processing | Data Modeling | Data Quality | Data Validation | Data quality monitoringWork from OfficeSenior-level InternshipGurgaon (Gurugram), Haryāna, India1d ago