Senior Product Manager, AI Inference - Dynamo
US, CA, Santa Clara, United States
USD 208K-327K Senior-level Full Time
Tasks
- Author PRDs
- Author software application design documents
- Collaborate on hardware/software co-design
- Define routing logic to minimize redundant prefill
- Design KV cache offloading strategy
- Develop agentic inference capabilities
- Drive product strategy for Dynamo modular components
- Integrate with SGLang
- Integrate with TensorRT LLM
- Integrate with vLLM
- Optimize time to first token
- Support multi turn stateful AI applications
Perks/Benefits
- N/A
Skills/Tech-stack
Agentic AI | Artificial Intelligence | Cache Management | Data-driven | Data-driven project management | Disaggregated serving | Distributed Systems | GPU Computing | KV cache | LLM Inference | MLOps | Machine Learning | Offloading | Prefill Decode | Product Management | Project Management | Responsible AI | Routing | Software Requirements | Systems Design | Time To First Token
Education
Roles
Regions
Countries
States
Cities
Related jobs
-
Alliances Manager (Databricks) USD 96K-190KAI analytics | AWS | Account Planning | Azure | Cloud Computing401k | Accident hospital indemnity | Critical illness | Dental plans | Identity theft protectionMid-level Full TimeFrisco, United States12h ago
-
Senior-level Full TimeDallas, Texas, United States14h ago
-
Site Manager, Robotics Teleoperation USD 139K-200KBash | Data Curation | Data Pipelines | Data Quality | Fleet ManagementMid-level Full TimeBurlingame, CA15h ago
-
Engineering Manager, Software Engineering USD 207K-300KCompilers | Data Compression | Developer tools | Distributed Systems | Infrastructure EngineeringSenior-level Full TimeSunnyvale, CA, USA15h ago
-
Accelerated computing | Artificial Intelligence | Audio Processing | Cloud infrastructure | Compute EngineSenior-level Full TimeSeattle, WA, USA15h ago
-
Senior Software Engineering Manager, Storage, AI/ML USD 262K-365KAI | Benchmarking | Cloud Storage | Compute Technologies | Data ProcessingSenior-level Full TimeSeattle, WA, USA15h ago
-
Manager, Decision Science Products USD 171K-230KA/B | A/B Testing | Agile | B testing | Backlog ManagementMid-level Full TimeUSA - CA - 820 S …1d ago
-
AWS Bedrock | AWS SageMaker | Agile | Amazon Web Services | AutomationHybrid remote work | Time awaySenior-level Full TimeAMER - United States - California …1d ago
-
Senior Manager Proposal Optimization USD 160K-190KBudgeting | Continuous Improvement | Cost Management | Governance | Project ManagementCareer development | Global opportunities | Pay transparencySenior-level Full TimeGrand Rapids, MI, United States, United …1d ago
-
Consulting: Manager, Marketing Data & Analytics USD 125K-145KData analytics | Descriptive Analytics | Excel | Market Research | Predictive ModelingCell stipend | Company laptop | Fitness Center | Flexible PTO | Health insuranceMid-level Full TimeWashington, DC1d ago
-
Consulting: Senior Manager, Marketing Data & Analytics USD 150K-175KClient Relationship Management | Client relationship | Database Marketing | Descriptive Analytics | Excel401k company match | ADandD Coverage | Business casual dress code | Calm app premium access | Cell stipendSenior-level Full TimeWashington, DC1d ago
-
API Development | AWS | Azure | Cloud platform | Compliance401k plan | Childcare discounts | Commuter benefits | Discounts at Marriott properties | Employee assistance planSenior-level Full TimeBethesda, MD, United States1d ago
-
Risk Management - Strategic Analytics - Vice President USD 245K-285KAnalytics | Compliance | Controls | Data analytics | ExcelBackup childcare | Comprehensive health care | Continuous professional development | Equal opportunity | Financial coachingExecutive-level Full TimeWilmington, DE, United States1d ago
-
Risk, Operational Risk (Artificial Intelligence Coverage), Vice President, Dallas or Salt Lake City USD 130K-250KAI Firewall | Acceptance Testing | Access Control | Agentic AI | Artificial IntelligenceExecutive-level Full TimeDallas, Texas, United States1d ago
-
Data Science Program Lead II USD 121K-230KClinical Practice | Clinical Research | Clinical trial | Clinical trial management | Data Management401k | Dental insurance | Medical insurance | Paid time off | Vision insuranceSenior-level Full TimeIrvine, CA, United States1d ago
-
Data Science Program Lead II USD 121K-230KClinical Practice | Clinical data | Clinical data management | Clinical trials | Data Management401k | Dental insurance | Long-term incentive program | Medical insurance | Paid HolidaysSenior-level Full TimeNorth Chicago, IL, United States1d ago
-
Data Science Program Lead I USD 121K-230KAnalytics | Clinical Practice | Clinical trial | Clinical trial management | Communication401k | Dental insurance | Health insurance | Paid time off | Short Term Incentive ProgramSenior-level Full TimeNorth Chicago, IL, United States1d ago
-
Data Science Program Lead I USD 121K-230KClinical Practice | Clinical Research | Clinical trial | Clinical trial management | GCP401k match | Dental insurance | Medical insurance | Paid Holidays | Paid time offSenior-level Full TimeIrvine, CA, United States1d ago
-
Director Project Controls & Analytics - AI USD 143K-181KAutomation | Business Intelligence | Change Management | Cost Management | Dashboarding401k match | Company-Paid Holidays | Dental insurance | Health insurance | Life insuranceExecutive-level Full TimeAnchorage, Alaska, United States; Remote, United … R1d ago
-
Internal AI Lead USD 170K-240KAI Agents | AI enablement | API Integration | Agent workflows | Artificial Intelligence401k plan | Catered meals | ClassPass membership | Commuter benefit | Fertility stipendEntry-level Full TimeSan Francisco1d ago
-
Product Manager, Databricks Experimentation Platform USD 111K-202KAI/ML Platforms | Cross-functional | Cross-functional leadership | Data Security | Enterprise AIBackup childcare | Financial coaching | Health insurance | Mental health support | On Site Health Wellness CentersMid-level Full TimeWilmington, DE, United States1d ago
-
Program Manager, Human Data USD 162K-240KArtificial Intelligence | Data Annotation | Data analytics | Machine Learning | Program ManagementMid-level Full TimeSan Francisco1d ago
-
Dashboard Development | Data Visualization | Dataiku | Hive | Impala401k | Medical/Dental/Vision insurance | Paid time off | Short Term Incentive ProgramMid-level Full TimeMettawa, IL, United States1d ago
-
Product Manager, Local Ads Data Platform USD 163K-237KArtificial Intelligence | Data Analysis | Data Infrastructure | Data Quality | Machine LearningMid-level Full TimeMountain View, CA, USA; Kirkland, WA, …1d ago
-
AI Governance | Agent systems | Architecture | Context engineering | Data SovereigntySenior-level Full TimeChicago, IL, USA; Atlanta, GA, USA1d ago