Lead - Data & Ml Platform
Bengaluru, Karnataka, India
INR 3000K-4800K (estimate) Senior-level Full Time
Tasks
- Architect lakehouse infrastructure
- Build ML lifecycle with MLflow
- Build consent management systems
- Build monitoring and observability systems
- Create RAG pipelines and vector stores
- Define enterprise data standards
- Design Delta Lake storage layer
- Develop developer platform SDKs and CLI
- Develop governance as code frameworks
- Develop model serving and deployments
- Enforce data contracts and SOR deduplication
- Enforce schema and freshness SLAs
- Ensure platform uptime and reliability
- Establish feature store governance
- Implement cost attribution and incident response
- Implement data pipeline consolidation
- Implement data quality anomaly detection
- Implement real time inference architecture
- Lead capacity planning
- Lead migration and schema standardization
- Maintain Unity Catalog governance
- Manage GPU TPU training and scheduling
- Manage cluster autoscaling
- Manage data catalog and lineage
- Manage incident management and runbooks
- Optimize query performance
- Orchestrate agent workflows
- Run FinOps chargeback and right sizing
Perks/Benefits
- N/A
Skills/Tech-stack
A/B | A/B Testing | Anomaly Detection | Apache Spark | Audit trails | Auto Scaling | B testing | CCPA | Canary Deployment | Chargeback | Cluster auto-scaling | Consent Management | Cost attribution | DPDP Act | Data Catalog | Data Lineage | Data Quality | Databricks | Delta Lake | Feature Store | FinOps | Flink | GDPR | GPU | Kafka | ML Ops | MLflow | Metadata Management | Monitoring | Mosaic AI | Observability | PII masking | Partitioning | Presto | Privacy Compliance | Query Optimization | RAG | Schema Enforcement | Streaming | TPU | Trino | Unity Catalog | Vector Database | Z-ordering
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Related jobs
-
Agentic Data Delivery Lead INR 2000K-4500KAWS | Access Control | Agent systems | Apache Hadoop | Apache SparkSenior-level Full TimePune, Maharashtra, India9h ago
-
Data Governance Engineer - Senior INR 1500K-2500KAgile | Amazon Web Services | Apache Hadoop | Apache Kafka | AzureSenior-level Full TimePune, Maharashtra, India13h ago
-
Agent Orchestration | Agentic AI | Cause analysis | Collibra | Data CatalogSenior-level Full TimeDLF CYBERCITY 12B, India19h ago
-
AVP - Data & ML Platform INR 3000K-4500KA/B | A/B Testing | Anomaly Detection | Audit trails | Auto ScalingSenior-level Full TimeBengaluru, Karnataka, India19h ago
-
Lead Platform Engineer (DevOps) INR 2200K-3500KAWS | Ansible | Azure | Bash | CI/CDHealthcare benefits | Hybrid work setting | Mentorship | Online learning platform | Paid time offSenior-level Full TimeIND-Pune-Equifax Analytics-PEC, India19h ago
-
Specialist, Master Data Stewardship INR 1000K-1700KAcceptance Testing | Anomaly Detection | Automation | CRM | Data GovernanceMid-level Full TimeIND - Telangana - Hyderabad (HITEC …1d ago
-
Data Platform Engineer INR 1400K-2000KAutomation | Data Modeling | Data integration | Databricks | Microsoft AzureMid-level Full TimeCoimbatore, CODC1A, India3d ago
-
MTS 1, Software Engineer, Data Platforms INR 2250K-2755KAgile | Algorithms | Compute efficiency | Data Structures | Distributed SystemsCareer development resources | Mentorship | Sustainable on-call practicesSenior-level Full TimeBangalore, India3d ago
-
Cloud & Data Platform Architect INR 2000K-4000KAWS | Alerting | Audit controls | Automated testing | AzureFlexible benefits packageSenior-level Full TimeGH Office: Hyderabad, India3d ago
-
Data Management Analyst-Data governance INR 800K-1100KCause analysis | Control monitoring | Controls Testing | Controls compliance | DashboardingMid-level Full Time110384-IND-HYDERABAD-INTL HYD WF CENTRE BLK 2 …3d ago
-
Senior Platform DevOps Engineer, Data and Analytics Platform INR 3000K-4000KAPI Gateway | AWS | AWS CDK | AWS CLI | AWS CloudFormationSenior-level Full TimePune, India4d ago
-
Senior-level Full TimeIND GBS Bangalore - Office, India4d ago
-
Mid-level Full TimeIndore, INDC1A, India4d ago
-
Specialist, Full-Stack AI Engineer INR 2300K-3500KARM Templates | AWS CloudFormation | Amazon Web Services | Authentication | AzureSenior-level Full TimeIND - Telangana - Hyderabad (HITEC …4d ago
-
Spclst , Analytics platform Engineer INR 1000K-1848KAWS | Azure | Bash | CI/CD | Cloud SecurityFlexible work arrangements | Hybrid work arrangements | Visa sponsorshipMid-level Full TimeIND - Telangana - Hyderabad, India4d ago
-
Senior Engineering Manager - Data Platform INR 2500K-4800KCloud Computing | Contract-driven Development | Data Catalog | Data Governance | Data IngestionEquity compensation | Flexible time off | Health & wellness benefits | Learning and development | Performance-based bonusSenior-level Full TimeIndia R5d ago
-
Sales & Commission Data Governance Analyst INR 1960K-2829KAudit Trail | CRM | Commercial finance | Data Governance | Data QualityEmployee Assistance Program (EAP) | Flexible working environment | LinkedIn Learning | Volunteer time offSenior-level Full TimePune, MH, India5d ago
-
Asc Specialist Data Governance INR 3000K-4000KAzure | Change Management | Collibra | Data Catalog | Data ClassificationFlexible workingSenior-level Full TimeBangalore, India5d ago
-
Senior Manager, Vx Data Governance and Enablement INR 1500K-2500KAgile | Change Management | Curriculum Development | Data Governance | Data ManagementSenior-level Full TimeIND - Mumbai, India5d ago
-
Asst Manager Data Governance & Privacy INR 700K-1600KArchitecture | BigID | CRM | Cloud Storage | DPDPAMid-level Full TimeMaharashtra, India5d ago
-
Data Platform Engineer INR 1500K-2000KBig Data | Data Governance | Data Quality | Data integration | DatabricksMid-level Full TimePune, PDC2C, India5d ago
-
Data Platform Engineer INR 1200K-2000KCloud Architecture | Data Modeling | Data Workflow | Data integration | Data workflow optimizationMid-level Full TimePune, PDC2C, India5d ago
-
Data Platforms and AI Access Control Lead INR 2475K-3380KAI Security | API Security | Access Control | Access Management | Access deprovisioningSenior-level Full TimeBengaluru Campus 31, India6d ago
-
Global Data Quality Assurance Lead INR 2040K-2800KAI | AWS | Amazon Web Services | Data Analysis | Data GovernanceFlexible work schedule | In office minimum three days per weekSenior-level Full TimeIndia - Chennai6d ago
-
Mid-level Full TimeBengaluru, BDC11A, India6d ago