Senior Product Manager - LLM Fleet Management
Tasks
- Adjust rate limits
- Apply PayGo spillover rules
- Automate capacity decisions
- Build capacity buffers for launches
- Build data pipelines for fleet health
- Build operational capacity models
- Create capacity plans for anchor customers
- Define and automate model capacity lifecycle
- Deprecate models
- Execute provider level failover
- Forecast and model capacity demand
- Handle burst scenarios
- Maintain dashboards and alert systems
- Manage fleet economics and spend
- Monitor TPM RPM utilization in real time
- Onboard new model capacity
- Optimize reservations vs PayGo tradeoffs
- Own capacity intelligence layer
- Stress test capacity projections
- Trigger PTU reservations
Perks/Benefits
- N/A
Skills/Tech-stack
API Integration | Automation Pipelines | Context window | Dashboards | Forecasting | LLM | Latency | Logging | Mathematics | PTU | PayGo | Product Management | Python | RPM | Rate Limiting | SQL | Splunk | Statistics | TPM | Tokens
Education
N/A
Roles
Related jobs
-
Assistant Manager - Analytics\..RBG - Analytics INR 1200K-2500KAdobe Analytics | Churn Prediction | Classification | Clickstream | ClusteringMid-level Full TimeBengaluru, Karnataka, India6h ago
-
Assistant Manager - Analytics\..RBG - Analytics INR 1200K-2500KAdobe Analytics | Churn Prediction | Classification | Clickstream analytics | ClusteringMid-level Full TimeBengaluru, Karnataka, India6h ago
-
Mid-level Full TimeAhmedabad, Gujarat, India7h ago
-
A/B | A/B Testing | Anomaly Detection | Auditability | B testingSenior-level Full TimePune, MH, India9h ago
-
Manager - AI Application Development INR 2500K-5000KAI Foundry | Arize Phoenix | Autogen | Azure AI | Azure AI FoundrySenior-level Full TimeGurgaon, Haryana, India12h ago
-
Manager - AI Application Development INR 2500K-5000KAI Foundry | Agent systems | Arize Phoenix | Autogen | Azure AISenior-level Full TimeGurgaon, Haryana, India12h ago
-
Vice President (Performance and Rewards) Analytics INR 600K-2000KAnalytics | Compensation modeling | Data Modeling | Data Visualization | Data integrationExecutive-level Full TimeBangalore, KA, IN, 56007617h ago
-
Risk Analytics - Process Mining - Manager INR 1500K-2525KARIS | Apromore | Artificial Intelligence | Automation Anywhere | BPMNGlobal mobility | Inclusive cultureMid-level Full TimeGurgaon, HR, IN, 12201017h ago
-
EY - GDS Consulting - AI And DATA - Snowflake plus AWS - Manager INR 1500K-2600KAI Engineering | API Integration | AWS Data | AWS Data Engineering | Amazon AthenaClient impact | Flexible Work N/A | Global career support | Inclusive culture | MentoringMid-level Full TimeKolkata, WB, IN, 70009117h ago
-
Principal QA Engineer – GenAI Testing - Manager INR 1500K-2829KAdversarial Testing | Artificial Intelligence | BDD | Benchmarking | CI/CDEmployee networks | Flexible work/life support | Hybrid work model | Inclusive development opportunities | Paid volunteer daysSenior-level Full TimeHyderabad, India17h ago
-
Mid-level Full TimeDGS India - Mumbai - Thane …17h ago
-
Manager, Software Engineering, ITC INR 2819K-4000KAPI first | API-First Development | AWS | AWS Serverless | Architectural DesignMid-level Full TimeINDIA TECHNOLOGY CENTER, India17h ago
-
Data Science Manager INR 1500K-2100KAWS | Adversarial Networks | Attribution Modeling | Azure | Cloud ComputingMid-level Full TimePune1d ago
-
AI/ML | Agent systems | Data readiness | Explainability | Generative AIAccess to advanced AI portfolio | Collaborative culture | Direct access to research engineers | Technical mentorshipSenior-level Full TimeMumbai, Maharashtra, India2d ago
-
Finance Data and Insights - Analytics Solutions Manager INR 1400K-2400KAccess Management | Agentic AI | Agile | Alteryx | Backlog ManagementMid-level Full TimeBengaluru, Karnataka, India3d ago
-
Data Analytics Sales Specialist Manager, Google Cloud INR 2000K-4000KData Lake | Enterprise Sales | Forecasting | Go-to-market | HadoopSenior-level Full TimeMumbai, Maharashtra, India; Bengaluru, Karnataka, India3d ago
-
Engineering Manager – AI Engineering BRL 1000KAutoscaling | C++ | CUDA | DeepSpeed | Distributed TrainingMid-level Full TimeBangalore, Karnataka3d ago
-
Mid-level Full TimeMumbai, Maharashtra, India3d ago
-
Enterprise Data Lead INR 3000K-4000KAPI | Anaplan | Automation | Boomi | Data CleansingAnnual leave | Development programmes | Employee assistance programme | Life insurance | Online learning platformSenior-level Full TimeBengaluru, KA, India R3d ago
-
IN_Senior Manager_PMO_Data and Analytics_Advisory_Gurgaon INR 2500K-3500KAgile | Amazon Web Services | Apache Airflow | Apache Hadoop | AzureFlexible work arrangements | Inclusive benefits | Mentorship | Wellbeing supportSenior-level Full TimeGurugram 10 C, India3d ago
-
Senior Manager - Data Engineer- Methodology & Assumption (M&A) Actuarial Policyholder Data Team INR 2817K-4064KApache Spark | Azure Databricks | Data Governance | Data Modeling | Data PipelinesSenior-level Full TimeMumbai Central Avenue, India3d ago
-
Manager, Data Scientist INR 1200K-2000KAirflow | Data Pipelines | Feature Engineering | Hadoop | HiveMid-level Full TimeGurgaon, India3d ago
-
Sr Product Manager - Enterprise Data Platform INR 3000K-5000KAgile | Analytics | Capacity Planning | Change Management | Cloud ArchitectureSenior-level Full TimeTower 02, Manyata Embassy Business Park, …3d ago
-
Data & Recon Division Lead INR 2000K-3500KData Privacy | Data Security | Jira | Microsoft Office | Project ManagementSenior-level Full TimeOffice - Noida, India3d ago
-
EY - GDS Consulting - AI And DATA - Supply Chain Operations Analytics - Senior Manager INR 3000K-4500KAWS | Agent systems | Anomaly Detection | Asset Maintenance | AzureSenior-level Full TimeBengaluru, KA, IN, 5600163d ago