Director, Product Management – AI Inference Platform
Location San Jose, California
USD 260K-351K Executive-level Full Time
Tasks
- Align cross functional collaborators
- Define and track platform performance metrics
- Define inference architecture and orchestration
- Define product vision
- Develop control plane services
- Develop product strategy and roadmap
- Drive inference execution and serving direction
- Enable hardware software co design
- Improve latency, throughput, and cost efficiency
- Manage KV cache strategy
- Optimize memory and token lifecycle
- Translate technical systems into customer value
Perks/Benefits
Skills/Tech-stack
AI Inference | API Development | Batching | Control Plane | Distributed Systems | Inference Serving | KV cache | Language Models | Large Language Models | Machine Learning | Memory Optimization | Performance optimization | Policy Management | Product Management | Routing | Scheduling | Tokenization
Education
N/A
Related jobs
-
Featured Feat. Associate Director, Data Labs USD 167K-167KAWS | Cloud Computing | Compute Infrastructure | Data Analysis | LLM GovernanceConference speaking opportunities | Hybrid work schedule | Media appearancesSenior-level Full TimeWashington, District of Columbia, 20004, United … R3d ago
-
Sr. Manager, Digital & AI Success USD 215K-338KArtificial Intelligence | Business Requirements | Cloud Computing | Customer Analytics | Data WorkflowEmployee stock purchase plan | Health insurance | Leave options | Life insurance | Paid time offSenior-level Full TimeAtlanta, GA Office (ATLANTA)15h ago
-
Principal AI Program Manager USD 145K-193KAI Governance | Artificial Intelligence | Change Management | Data Preparation | Enterprise Architecture401k matching | Paid sick leave | Paid vacation time | Tuition reimbursementSenior-level Full TimeSan Jose, CA, United States15h ago
-
Director, AI Product Manager USD 170K-220KAI FinOps | AI Governance | AIOps | Amazon SageMaker | Apache SparkAdoption Assistance | Disability insurance | Educational assistance | Flexible spending account | Health benefits (medical, dental, vision)Executive-level Full TimeLisle, Illinois20h ago
-
Managers, Data Science USD 90K-165KDecision Trees | HiveQL | Linear Regression | Logistic Regression | Machine LearningAccess to wellness centers | Career development and training opportunities | Comprehensive medical, dental, vision and life insurance | Disability benefits | Free counseling supportMid-level Full TimeNew York, NY, United States1d ago
-
Technology Mgr, Quality Systems, AI Lead USD 102K-204KAdvanced Analytics | Artificial Intelligence | Audit management | Continuous Improvement | DashboardsSenior-level Full TimeUS014 MA Raynham - 325 Paramount …1d ago
-
Manager - Finance Reporting and Analytics USD 66K-145KBW/4HANA | BigQuery | Cloud Data | Cloud Data Platforms | DashboardsMedical, dental & vision coverage | Paid time off | Retirement savings | Wellness programsMid-level Full TimeWork At Home-Rhode Island, United States1d ago
-
Senior Deposit Pricing and Analytics Executive - GWIM USD 180K-241KBusiness Analytics | Competitor Analysis | Continuous Improvement | Data Analysis | Financial AnalysisFlexible benefits | In-office collaboration | Paid time offSenior-level Full TimeNew York, United States1d ago
-
Director, PBM Data Governance & Strategy USD 100K-231KBusiness Intelligence | Cross-functional | Cross-functional leadership | Data Architecture | Data EnrichmentDental coverage | Hybrid work | Medical coverage | Paid time off | Retirement savings optionsExecutive-level Full TimeNorthbrook-3100 Sanders Road, United States R1d ago
-
Director, Workforce Analytics USD 110K-193KCapital analytics | Data Governance | Data Quality | Data Visualization | Data analytics401k | Dental insurance | Flexible work from home | Health insurance | Life insuranceExecutive-level Full Time08579 Minneapolis Headquarters 901, United States1d ago
-
Director, Data & Analytics Engineering USD 125K-135KAPI Development | Calculus | Decision Tree | Deep learning | Distributed TrainingTelecommuting up to 2 days per weekExecutive-level Full TimeAlpharetta GA 6655, United States R1d ago
-
Senior Deposit Pricing and Analytics Executive - GWIM USD 180K-241KBusiness Analytics | Competitor Analysis | Continuous Improvement | Data Analysis | Financial ModelingPaid time offSenior-level Full TimeNew York, United States1d ago
-
Consumer Banking American Dream Analytics Director USD 180K-237KA/B | A/B Testing | Agentic AI | Artificial Intelligence | Attribution ModelingExecutive-level Full TimeColumbus, OH, United States1d ago
-
Supervisor of AI Software Engineering USD 185K-195KAPI Development | Agile | Azure DevOps | CI/CD | CORS401k plan | Disability insurance | Health insurance | Life insurance | PTO programMid-level Full TimeLos Angeles, CA, United States1d ago
-
VP Marketing Data Science USD 129K-194KA/B | A/B Testing | B testing | Data Visualization | Dataiku401k | Accident insurance | Disability insurance | Life insurance | Medical, dental, and vision coverageExecutive-level Full TimeLocation(s): New York, New York, United …2d ago
-
Artificial Intelligence | Causal Inference | Change Management | Customer Segmentation | Data GovernanceBackup childcare | Financial coaching | Health care coverage | Mental health support | On-site health and wellness centersExecutive-level Full TimeNew York, NY, United States2d ago
-
APIs | Access Control | CI/CD | Cloud Data | Cloud data platformDefined benefit pension plan | Health insurance | Tax-deferred savings program | Work from home | Worksite wellness programExecutive-level Full TimeLong Island City, NY, United States2d ago
-
Technical Program Manager, MTIA Software USD 167K-230KAI Algorithms | AI Inference | AI Training | AI accelerator | BenchmarkingMid-level Full TimeMenlo Park, CA2d ago
-
Director, Technical Program Management (Ranking AI) USD 240K-309KAd-Tech | Advertising Technology | Artificial Intelligence | Bias Mitigation | Cross-Functional CollaborationExecutive-level Full TimeSunnyvale, CA2d ago
-
AWS | Alerting | Black box monitoring | Black-box | CI/CDBackup childcare | Financial coaching | Mental health support | Mentoring | Onsite health and wellness centersSenior-level Full TimeJersey City, NJ, United States3d ago
-
Manager, Data Analytics USD 98K-133KAutomation | Dashboard Development | Data Modeling | Data Visualization | Data WarehousingMid-level Full TimeStamford - 56 Top Gallant, United …3d ago
-
Technical Manager - LLMs, RAG and ML USD 120K-160KBenchmarking | Data Generation | Embedding | Evaluation methods | Faiss401k match | Career advancement opportunities | Commuter benefits | Dental benefits | Dependent care assistanceMid-level Full TimeOakland, CA, United States3d ago
-
Sr. Manager, Credit Risk Analytics USD 136K-207KA/B | A/B Testing | AI | Advanced Analytics | B testing401k company match | Childcare assistance | Flexible time off | Health insurance | Hybrid workSenior-level Full TimeUnited States R3d ago
-
Manager, Applied AI Engineering USD 300K-405KAgent Development | Evaluation Frameworks | LLM Deployment | Language Models | Large Language ModelsHybrid work policy | Visa sponsorship supportSenior-level Full TimeSan Francisco, CA | New York …3d ago
-
Senior Product Manager, Data Platform (Remote) USD 162K-215KAI | Access Control | Business Intelligence | Cost Optimization | Data CatalogBusiness events | Remote work | Team gatherings | Together Weeks | Travel up to 5 days per quarterSenior-level Full TimeBoston, MA R3d ago