Director, Product Management – AI Inference Platform
Location San Jose, California
USD 260K-351K Executive-level Full Time
Tasks
- Align cross functional collaborators
- Define and track platform performance metrics
- Define inference architecture and orchestration
- Define product vision
- Develop control plane services
- Develop product strategy and roadmap
- Drive inference execution and serving direction
- Enable hardware software co design
- Improve latency, throughput, and cost efficiency
- Manage KV cache strategy
- Optimize memory and token lifecycle
- Translate technical systems into customer value
Perks/Benefits
Skills/Tech-stack
AI Inference | API Development | Batching | Control Plane | Distributed Systems | Inference Serving | KV cache | Language Models | Large Language Models | Machine Learning | Memory Optimization | Performance optimization | Policy Management | Product Management | Routing | Scheduling | Tokenization
Education
N/A
Related jobs
-
Featured Feat. Associate Director, Data Labs USD 167K-167KAWS | Cloud Computing | Compute Infrastructure | Data Analysis | LLM GovernanceConference speaking opportunities | Hybrid work schedule | Media appearancesSenior-level Full TimeWashington, District of Columbia, 20004, United … R25d ago
-
Senior Manager, Data Science USD 165K-256KA/B | A/B Testing | Ad Spend | Artificial Intelligence | Attribution401k matching | Disability insurance | Life insurance | Medical/Dental/Vision insurance | Paid Company HolidaysSenior-level Full TimeLocations: Redwood City, California, United States …6h ago
-
AWS | Agentic AI | Agile | Azure | Business IntelligenceDiscretionary incentive program | Hybrid work model | Mentorship | Professional developmentSenior-level Full TimeAustin, Texas, United States; Dallas, Texas, …6h ago
-
Senior Manager, Data Science USD 142K-222KA/B | A/B Testing | Artificial Intelligence | B testing | Channel attributionCommunity health | Free games | Hybrid work schedule | Medical insurance | Mental health supportSenior-level Full Time地点：Redwood City, California, United States of …7h ago
-
Product Management, Director - AI Platforms and Infra USD 249K-323KData Pipelines | Developer experience | Experimentation | Feature Engineering | Machine LearningTeam leadership developmentExecutive-level Full TimeMenlo Park, CA8h ago
-
Product Manager, CTM Intelligence USD 192K-279KAPI Design | Agentic AI | Classifier Models | Intent detection | LLM orchestrationSenior-level Full TimeSunnyvale, CA, USA8h ago
-
Product Manager, Responsible AI Infra USD 163K-237KAI Evaluation | Artificial Intelligence | Automated compliance | Compliance | Data GovernanceMid-level Full TimeMountain View, CA, USA8h ago
-
Data Processing | Data orchestration | Data pipeline | Data pipeline management | Dataset ManagementExecutive-level Full TimeSan Jose, CA, USA9h ago
-
Software Engineering Manager II, AI/ML, Google Cloud USD 207K-301KC# | C++ | Cloud platform | Data Processing | DebuggingSenior-level Full TimeSunnyvale, CA, USA9h ago
-
Bigtable | C++ | Colossus | Data Processing | Data StorageSenior-level Full TimeMountain View, CA, USA9h ago
-
Senior Data Science Manager USD 160K-200KCausal Inference | Coded Quality | Data Pipelines | Data Visualization | Experiment designSenior-level Full TimeCupertino17h ago
-
Sr Product Manager - Data Science USD 92K-167KData Analysis | Data Visualization | Distributed Computing | Healthcare | Hive401k savings plan | Annual incentive bonus plan | Disability insurance | Employee assistance program | Paid HolidaysSenior-level Full TimeChicago Illinois HQ (300 E. Randolph …20h ago
-
Director, Foundation Model Data Recipes USD 349K-431KBayesian Inference | Data Clustering | Data Filtering | Data Mining | Data PreprocessingBonus | Equity incentive plan | Health insuranceExecutive-level Full TimeMountain View, CA. USA; San Francisco, …21h ago
-
Senior Program Manager, AI & Data USD 157K-205KAgile | Amazon Web Services | Analytics | BI | BudgetingCoaching and mentoring | Ownership | Remote-firstSenior-level Full TimeUS - Remote R22h ago
-
Program Manager, AI & Data USD 125K-165KAgile | Amazon Web Services | Artificial Intelligence | Azure DevOps | Cloud platformMid-level Full TimeUS - Remote R22h ago
-
GenAI Account Manager USD 160K-205KAI Safety | Account Management | Communication | Consultative selling | Language ModelsCareer growth opportunities | Professional developmentMid-level Full TimeNew York, NY, US22h ago
-
Sr Engineering Program Manager, AIML Foundation Models USD 165K-293KCo-design | Cross-Functional Collaboration | Cross-functional | Data Pipelines | Distributed TrainingSenior-level Full TimeCupertino22h ago
-
API Design | Data Modeling | Distributed Systems | Low Latency | Low-Latency SystemsHybrid workMid-level Full TimeHQ-San Francisco22h ago
-
Manager-Data Science USD 90K-165KApache Hive | Big Data | ChatGPT | Data Mining | Decision TreesCareer development opportunities | Holistic wellbeing support | Learning opportunities | Visa sponsorshipMid-level Full TimeNew York, NY, United States23h ago
-
Senior Director, Decision Analytics USD 200K-275KAI Automation | ARR | BI Visualization | CAC Payback | Change ManagementDental insurance | Disability insurance | Flexible paid time off | Health insurance | Life insuranceSenior-level Full TimeRemote US R23h ago
-
Manager, Analytics and Market Research USD 137K-202KAgile | Data Analysis | Data Visualization | Dataiku | Machine Learning401k | Health insurance | Long-term incentive program | Paid time offMid-level Full TimeMettawa, IL, United States1d ago
-
Engagement Manager (Computer Vision), Public Sector USD 187K-234KAnalytics | B2B Customer Management | Computer Vision | Customer Management | MLOpsCommuter stipend | Generous PTO | Health, dental and vision coverage | Learning and development stipend | Retirement benefitsMid-level Full TimeWashington, DC1d ago
-
Applied AI, Product Manager-Payments-Vice President USD 235K-285KAI orchestration | API Integration | Agentic Workflows | Agile delivery | Artificial IntelligenceBackup childcare | Equal opportunity employment | Financial coaching | Health care coverage | Mental health supportExecutive-level Full TimeBrooklyn, NY, United States1d ago
-
Financial Data and Analytics Manager USD 95K-142KArtificial Intelligence | Big Data | Big Data Integration | CRM | Data EngineeringHealthcare coverage | Retirement planMid-level Full TimeColumbia, Maryland, United States1d ago
-
AWS | Access Management | Active Active Resilience | Active/Active | AgileExecutive-level Full TimeJersey City, NJ, United States1d ago