Senior Product Manager – AI Inference Performance
Tasks
- Build reusable inference performance platforms
- Define framework and ecosystem strategy
- Define performance strategy for agentic and multi turn workloads
- Manage release readiness and quality bars
- Own benchmarking and performance claims
- Own inference performance roadmap
- Track regressions and resolve customer blocking issues
- Translate inference optimization into business value
Perks/Benefits
- N/A
Skills/Tech-stack
Artificial Intelligence | Benchmarking | Inference Optimization | Inference Server | KV cache | Latency optimization | Machine Learning | Nvidia Dynamo | Performance Measurement | Quantization | Regression testing | Release Management | Request Scheduling | SGLang | Speculative decoding | TensorRT-LLM | Throughput Optimization | Triton Inference | Triton Inference Server | VLLM
Education
Bachelor of Engineering | Bachelor of Science | Master of Science | PhD
Roles
Regions
Countries
States
Related jobs
-
Senior Developer Relations Manager, Data Platforms USD 224K-356KBusiness Development | Cloud Computing | Data Storage | Database technologies | Deep learningSenior-level Full TimeUS, CA, Santa Clara2d ago
-
Autonomous Vehicles | Cosmos | Data Curation | Data Generation | Deep learningSenior-level Full TimeUS, CA, Santa Clara R9d ago
-
Accelerated computing | CUDA | Competitive Analysis | Data center | Data center architectureSenior-level Full TimeUS, CA, Santa Clara9d ago
-
Manager, Large Language Model Inference USD 184K-356KAPI Development | C++ | CUDA | GPU Architecture | PythonEquity | Flexible work options | Health insurance | Paid time offMid-level Full TimeUS, CA, Santa Clara R9d ago
-
Senior Product Manager - AI Platform Inference USD 168K-258KGPU Architecture | Generative AI | Go-to-market | Inference Optimization | Machine LearningEmployee benefits | EquitySenior-level Full TimeUS, CA, Santa Clara9d ago
-
Engineering Manager, LLM Performance USD 224K-356KAPIs | C++ | CUDA | GPU Architecture | LLM InferenceMid-level Full TimeUS, CA, Santa Clara9d ago
-
Engineering Manager, AI Developer Technology USD 184K-356KC plus plus | CPU architecture | CUDA | Computer Architecture | Deep learningEmployee benefits | Equity | Hybrid workSenior-level Full TimeUS, CA, Santa Clara9d ago
-
Senior Manager, Robotics Quality Assurance USD 216K-345KAI Foundation | AI foundation models | Digital Twins | Embedded Systems | Foundation ModelsSenior-level Full TimeUS, CA, Santa Clara11d ago
-
Senior Technical Program Manager - Robotics USD 168K-258KAgile | Edge Deployment | Imitation Learning | Machine Learning | PythonSenior-level Full TimeUS, CA, Santa Clara14d ago
-
Mid-level Full TimeUS, CA, Santa Clara R17d ago
-
Agile Development | Artificial Intelligence | CI/CD | Deep learning | DeploymentEquity | Health benefitsSenior-level Full TimeUS, CA, Santa Clara R17d ago
-
Machine Learning Engineering Manager, Evaluation, Agentic Search Capabilities, Proactive USD 174K-284KC++ | Data Curation | Data Generation | Data Quality | Data quality assessmentMid-level Full TimeSanta Clara25d ago