Product Manager - AI Inference & Model Serving
Austin, TX, United States
USD 165K-275K (estimate) Mid-level Full Time
Tasks
- Collaborate on system design trade offs for serving topology
- Define lifecycle for inference services
- Define performance measurable outcomes and metrics
- Drive go to market execution for inference products
- Lead technical discovery and translate findings into requirements
- Own product strategy and roadmap for inference and model serving
Perks/Benefits
Skills/Tech-stack
AI Inference | Artificial Intelligence | Autoscaling | Cache Management | Continuous batching | Disaggregated serving | Distributed Systems | GPU scheduling | Inference Server | KV cache | KV-cache management | Latency optimization | Machine Learning | Model Serving | Multi model serving | Multi-model | Network Optimization | Observability | Performance Engineering | Reliability Engineering | Routing | SGLang | Serverless | Storage Optimization | TensorRT-LLM | Throughput Optimization | Triton Inference | Triton Inference Server | VLLM | Workload placement
Education
N/A
Roles
Related jobs
-
Senior Product Manager - Data Platform USD 140K-165KAgile | Anomaly Detection | Batch Processing | BigQuery | Consent Management401k matching | Dental insurance | Disability insurance | Flexible time off | Life insuranceSenior-level Full TimeJersey City, NJ, United States10h ago
-
Senior Manager / Principal Data Science USD 155K-178KAI Agents | Dashboards | Data Pipelines | Data Visualization | LLMHybrid workSenior-level ContractDeerfield Beach, United States10h ago
-
Autoscaling | Deep learning | Distributed Systems | Elastic Systems | KubernetesMid-level Full TimeSan Jose, California, United States11h ago
-
C# | C++ | Computer Vision | Data Processing | DebuggingSenior-level Full TimeKirkland, WA, USA12h ago
-
Senior Data Science Manager - Marketing Science USD 180K-210KAttribution Modeling | Causal Inference | Difference-in-differences | Language Models | Language Processing401k match | Annual bonuses | Company equipment provided | Company medical dental vision plans | Disability benefitsSenior-level Full TimeAtlanta, GA preferred, Remote R23h ago
-
Manager, AI Engineering - Analytics USD 197K-267KAgent systems | Artificial Intelligence | Data Modeling | Data Warehousing | EvalsHybrid work flexibility | Professional growth opportunities | Stock equity | Work-life balanceMid-level Full TimeHybrid - San Francisco R1d ago
-
AI Solutions Manager, Digital Native USD 140K-175KAI Observability | AI systems | CRM | Customer Success | Data Infrastructure401k | Medical/Dental/Vision | Mental wellness support | Parental leave | Unlimited paid time offMid-level Full TimeRemote (San Francisco) R1d ago
-
Senior Manager, People Analytics & Insights USD 119K-175KArtificial Intelligence | Automation | Data Modeling | Data integration | DomoSenior-level Full TimeChicago, Illinois, United States; Jersey City, …1d ago
-
Technical Program Manager, Gemini Evals, DeepMind USD 217K-237KCapacity Planning | Compute Capacity Planning | Compute capacity | Data Science | ExperimentationMid-level Full TimeMountain View, CA, USA1d ago
-
Acceptance criteria | Agile | Analytics | Artificial Intelligence | Backlog ManagementHybrid workSenior-level Full TimeNew York, New York, United States1d ago
-
Manager, Data Analytics USD 135K-155KAgile | Azure | Azure Data | Azure Data Factory | Azure OpenAI401k employer match | Accident insurance | Critical illness insurance | Dental insurance | Flexible Spending PlansMid-level Full TimeOrlando, FL, United States1d ago
-
Engineering Manager, Machine Learning USD 250K-275KData pipeline | Experiment design | Inference Optimization | Language Models | Language ProcessingHybrid workMid-level Full TimeBoston or NYC1d ago
-
Product Owner - Advanced Analytics & Research USD 116K-172KAPI first | Artificial Intelligence | Azure | CI/CD | CommunicationContinuous learning culture | Inclusion and empowerment culture | On-site work flexibility | Remote work potentialSenior-level Full TimeOH Cin-Dixie Terminal No, United States2d ago
-
Artificial Intelligence | Client Management | Data Modeling | Data Warehousing | Machine LearningCareer development opportunities | Entrepreneurial environment | High degree of individual responsibilitySenior-level Full TimeFoster City, California, United States2d ago
-
Associate Director, Commercial AI & Advanced Analytics USD 137K-235KA/B | A/B Testing | Artificial Intelligence | B testing | Budget Management401k retirement plan | Dental insurance | Life insurance | Long-term disability | Medical insuranceMid-level Full TimeUS010 PA Horsham - 800/850 Ridgeview …2d ago
-
Manager, Fraud Detection and Analytics USD 97K-185KAnomaly Detection | Dashboards | Data Visualization | Fraud Detection | Machine LearningEducational assistance | Emotional well-being support | Health care coverage | Paid time off | Parental leaveMid-level Full Time1 Spartan Way, Merrimack NH, United …2d ago
-
Agentic AI | Analytics | Artificial Intelligence | Cybersecurity | Data ArchitectureHealth insurance | Relocation assistance | Retirement savings plansSenior-level Full TimeUSA - Dallas, TX, United States2d ago
-
Senior Product Manager, Applied AI — Financial Markets USD 126K-211KAgentic AI | Artificial Intelligence | Data Analysis | Language Models | Large Language Models401k match | Adoption Assistance | Annual wellness allowance | Commuter assistance | DentalSenior-level Full TimeNew York, United States, United States2d ago
-
Sr. Manager Data Science, Logistics Modeling USD 128K-170KArtificial Intelligence | Machine Learning | Mathematics | Optimization | PythonSenior-level Full Time8901 - Corp Office West Crk, …2d ago
-
Data Science Manager, Personalization USD 85K-126KA/B | A/B Testing | Apache Spark | B testing | Confidence IntervalsCareer development | Diversity and inclusion focus | Onsite work 4 days per week | TrainingMid-level Full Time8901 - Corp Office West Crk, …2d ago
-
Marketing Operations & Analytics Manager USD 120K-120K6sense | ABM | ABX | Attribution | Campaign QADisability insurance | Employee assistance program | Group term life insurance | Home-office allowance | Internet reimbursementSenior-level Full TimeRemote, Oregon, United States R2d ago
-
Manager Analytics & AI USD 112K-160KAI Governance | AI Services | Azure AI | Azure AI Services | Azure Copilot401k retirement savings plan | Dental insurance | Health insurance | Paid Company Holidays | Paid parental leaveSenior-level Full TimeTampa, Florida, US, 336072d ago
-
AI Product Manager USD 105K-195KAI Foundry | Advanced Analytics | Azure | Azure AI | Azure AI FoundryMid-level Full TimeMahwah, NJ, US, 074302d ago
-
Databricks Data Engineer - Manager - Consulting - Miami USD 125K-261KAWS | Azure | Change Management | Cloud Computing | Cloud Data401k plan | Dental coverage | Hybrid work model | Medical coverage | Paid time offMid-level Full TimeMiami, FL, US, 33136-4118 R2d ago
-
Artificial Intelligence | Azure | Cloud platform | Data Architecture | Data EngineeringSenior-level Full TimeDallas, TX, US, 75219 R2d ago