Senior Product Manager, AI Inference - Dynamo
US, CA, Santa Clara, United States
USD 208K-327K Senior-level Full Time
Tasks
- Author PRDs
- Author software application design documents
- Collaborate on hardware/software co-design
- Define routing logic to minimize redundant prefill
- Design KV cache offloading strategy
- Develop agentic inference capabilities
- Drive product strategy for Dynamo modular components
- Integrate with SGLang
- Integrate with TensorRT LLM
- Integrate with vLLM
- Optimize time to first token
- Support multi turn stateful AI applications
Perks/Benefits
- N/A
Skills/Tech-stack
Agentic AI | Artificial Intelligence | Cache Management | Data-driven | Data-driven project management | Disaggregated serving | Distributed Systems | GPU Computing | KV cache | LLM Inference | MLOps | Machine Learning | Offloading | Prefill Decode | Product Management | Project Management | Responsible AI | Routing | Software Requirements | Systems Design | Time To First Token
Education
Roles
Regions
Countries
States
Cities
Related jobs
-
Sr. Tech Lead, GTM Applied AI & Analytics USD 150K-243KAirflow | Data Warehousing | Databricks | Fine Tuning | LLM APIsSenior-level Full TimeSan Francisco, CA, United States6h ago
-
Product Lead, Applied AI, Data and Analytics Platform USD 192K-278KAccess Control | Analytics | Artificial Intelligence | BigQuery | Data LineageSenior-level Full TimeMountain View, CA, USA7h ago
-
Senior Technical Program Manager, AI/ML, Finance USD 192K-278KArtificial Intelligence | Business Intelligence | Data Architecture | Data Governance | Data WarehousingSenior-level Full TimeSunnyvale, CA, USA7h ago
-
Technical Program Manager III, Machine Learning, Core USD 163K-237KArtificial Intelligence | Automation | Deep learning | Machine Learning | Speech RecognitionSenior-level Full TimeSunnyvale, CA, USA7h ago
-
Manager, IT AI Engineering - Agent Engineering USD 96K-131KA/B | A/B Testing | API Design | Access Control | Agent architecture401k program | Car discounts | Cruise discounts | Employee assistance program | Flexible spending accountsMid-level Full TimeFort Worth, TX, US11h ago
-
AWS CloudFormation | Amazon Web Services | Anomaly Detection | Attribution Modeling | Budget Quota ManagementSenior-level Full TimeMountain View, California18h ago
-
Sr Manager, People Analytics Insight Partner USD 182K-235KAWS | Advanced Statistics | Analytics | Business Analytics | Data ManagementDental insurance | Health insurance | Life insurance | Paid time off | Vision insuranceSenior-level Full TimeUS - CA - Foster City, …18h ago
-
Data Science Program Lead I USD 121K-230KClinical Practice | Clinical Research | Clinical trial | Clinical trial management | Data Analysis401k | Dental insurance | Long-term incentive program | Medical insurance | Paid time offSenior-level Full TimeIrvine, CA, United States23h ago
-
Data Science Program Lead I USD 121K-230KClinical Practice | Clinical data | Clinical data management | Clinical trial | Clinical trial management401k | Dental insurance | Long-term incentive program | Medical insurance | Paid time offSenior-level Full TimeNorth Chicago, IL, United States23h ago
-
Engineering Manager - AI Cloud Platform USD 330K-440KBackend Development | Cluster Lifecycle Automation | Cluster lifecycle | Distributed Systems | Go401k match | Commuter stipend | Dental insurance | Flexible paid time off | Health insuranceMid-level Full TimeSan Francisco Office23h ago
-
AI Lead Technical Program Manager USD 176K-245KAgile | Artificial Intelligence | Budget Management | Data Analysis | Project PlanningSenior-level Full TimeColumbus, OH, United States1d ago
-
Manager, Reporting & Analytics USD 93K-114KAnalytics | Dashboards | Data Governance | Data Quality | Data VisualizationHealth and wellness benefits | PERA Retirement | Time offMid-level Full TimeDenver, CO, United States1d ago
-
Architecture Review | Cloud Data | Cloud Data Architecture | Consumption-based models | Customer Architecture ReviewSenior-level Full TimeUS-NY-New York1d ago
-
Senior Manager, Machine Learning USD 141K-187KAWS SageMaker | Amazon ECS | Amazon EKS | Amazon Web Services | Apache SparkGenerous time off | Healthcare | Paid parental leave | Paid personal time off | Paid sick timeSenior-level Full TimeRemote - US R1d ago
-
Sr. Manager Of AI Cloud Engineering USD 139K-184KAzure | Azure Cognitive | Azure Cognitive Services | CI/CD | Cloud ArchitectureHybrid work modelSenior-level Full TimeOakland, CA, United States1d ago
-
Associate Director, Market Research and Analytics - GIC USD 137K-261KAnalytics modeling | Behavioral analytics | Competitive Intelligence | Data Visualization | Data strategy401k | Dental insurance | Health insurance | Long-term incentive program | Paid time offMid-level Full TimeMettawa, IL, United States1d ago
-
Assistant Director, Analytics USD 135K-135KAgile | Apache Airflow | Business Intelligence | DBT | Data VisualizationExecutive-level Full TimeWashington, District of Columbia, United States; …1d ago
-
Senior Technical Product Manager - ML & Analytics USD 92K-142KAgile | Analytics | Artificial Intelligence | Automation tools | Data Pipelines401k plan | Commuter benefits | Dental insurance | Employee stock purchase program | Medical insuranceSenior-level Full TimeAustin, TX; Toronto, Canada1d ago
-
APIs | AWS | Agile | Artificial Intelligence | Azure401k match | Dental insurance | Educational reimbursement | Flexible work schedules | Health insuranceSenior-level Full TimeRemote, United States R1d ago
-
Engineering Manager, Data Infrastructure USD 165K-242KAgile | Apache Airflow | Apache Iceberg | Apache Spark | Automation401k match | Catered lunch | Employee stock purchase program | Family forming support | Flexible PTOSenior-level Full TimeNew York, NY/Bellevue, WA1d ago
-
Senior Manager, Analytics and Insight (Hybrid) USD 169K-186KA/B | A/B Testing | Attribution Modeling | B testing | DBT401k match | Dental insurance | HSA contribution | Health insurance | Paid parental leaveSenior-level Full TimeNew York, NY R1d ago
-
Technology & AI Solutions Partner USD 140K-190KAI | AI Governance | Azure | Cybersecurity | Data Protection401k match | Accidental death and dismemberment | Dental insurance | Device purchase support | FSASenior-level Full TimeRedwood City, CA1d ago
-
Sr. Product Manager - Intelligence Data Platform & AI USD 150K-190KAnalytics | Artificial Intelligence | Business Strategy | Data Architecture | Data Ingestion401k match | Caregiver leave | Flexible vacation | HSA contribution | Health insuranceSenior-level Full TimeUnited States1d ago
-
Operations Program Manager- Robotics USD 134K-196KAI Workflow Optimization | AI tools | AI workflow | Budget Forecasting | BudgetingMid-level Full TimeRedmond, WA1d ago
-
Technical Lead Manager, AI/ML Networking USD 207K-300KArtificial Intelligence | C++ | Compute Technologies | Dataplane Encryption | Deep Learning Execution ProviderSenior-level Full TimeRaleigh, NC, USA; Durham, NC, USA1d ago