Product Manager - AI Inference & Model Serving
USD 165K-275K (estimate) Mid-level Full Time
Tasks
- Collaborate on system design trade offs for serving topology
- Define lifecycle for inference services
- Define performance measurable outcomes and metrics
- Drive go to market execution for inference products
- Lead technical discovery and translate findings into requirements
- Own product strategy and roadmap for inference and model serving
Perks/Benefits
Skills/Tech-stack
AI Inference | Artificial Intelligence | Autoscaling | Cache Management | Continuous batching | Disaggregated serving | Distributed Systems | GPU scheduling | Inference Server | KV cache | KV-cache management | Latency optimization | Machine Learning | Model Serving | Multi model serving | Multi-model | Network Optimization | Observability | Performance Engineering | Reliability Engineering | Routing | SGLang | Serverless | Storage Optimization | TensorRT-LLM | Throughput Optimization | Triton Inference | Triton Inference Server | VLLM | Workload placement
Education
N/A
Roles
Related jobs
-
Featured Feat. Associate Director, Data Labs USD 167K-167KAWS | Cloud Computing | Compute Infrastructure | Data Analysis | LLM GovernanceConference speaking opportunities | Hybrid work schedule | Media appearancesSenior-level Full TimeWashington, District of Columbia, 20004, United … R11d ago
-
Tech Lead Manager, Inference USD 207K-300KAutoscaling | Cache Management | Caching | Continuous batching | Deployment PipelinesSenior-level Full TimeSF Bay Area, CA5h ago
-
Senior-level Full TimeUnited States7h ago
-
Engineering Manager, Research Data Platform USD 405K-850KAnalytics Storage | Apache Spark | ClickHouse | Columnar Storage | Data CatalogingFlexible working hours | Generous vacation | Hybrid work flexibility | Office collaboration space | Optional equity donation matchingMid-level Full TimeSan Francisco, CA | New York …17h ago
-
Senior Manager, AI & Analytics USD 158K-246KAccounting systems | Auditability | Compliance | Contract Management | Data ArchitectureComprehensive benefits | Performance-based bonuses | Wellness programs | Work-life balanceSenior-level Full TimeChicago, United States20h ago
-
Manager, AI Deployment Engineering — Enterprise (ProServe, Media, Telco, Private Equity) USD 251K-335KArchitecture | Artificial Intelligence | Cloud infrastructure | Cost Optimization | Data GovernanceMid-level Full TimeSan Francisco22h ago
-
Manager of Data Engineering USD 140K-160KAWS | Azure | Data Modeling | Data Warehousing | Data pipelineMid-level Full TimeBaltimore, MD23h ago
-
Sr. Engineering Manager, AI Runtime USD 228K-297KCheckpointing | DeepSpeed | Distributed Systems | Elastic Training | FSDPSenior-level Full TimeMountain View, California; San Francisco, California23h ago
-
Associate Director, Data & AI Governance USD 129K-169KAI Act | AI Fairness | AI model | AI model risk | AI model risk managementMid-level Full TimeFlorida, United States23h ago
-
Staff Product Manager, Machine Learning USD 160K-200KB2B Product | B2B Product Management | Computer Vision | Data Ingestion | Data PipelinesCollaborative work environment | Coworking budget | Flexible remote work | Home office stipend | Ongoing education budgetSenior-level Full TimeRemote: United States | Canada | … R1d ago
-
Asset & Wealth Management - Product Manager, Applied AI & Data Products - Vice President USD 235K-270KAI Agents | Artificial Intelligence | Backlog Management | Data Governance | Data QualityBackup childcare | Financial coaching | Health care coverage | Mental health support | On-site wellness centersExecutive-level Full TimeJersey City, NJ, United States1d ago
-
Benefit Services Senior Leader - Group Fulfillment USD 119K-154KAgent Development | Artificial Intelligence | Automation | Budget Management | CalibrationSenior-level Full TimeDenver, CO; Chicago, IL; Phoenix, AZ1d ago
-
API Integration | Agile | Artificial Intelligence | Backlog Grooming | Corporate Treasury ManagementExecutive-level Full TimeJersey City, NJ, United States1d ago
-
API Design | Agile | Angular | Artificial Intelligence | Automated testingSenior-level Full TimeChicago, IL, United States1d ago
-
Data Science Manager - TikTok Ads USD 153K-296KData Analysis | Data Modeling | Data Pipelines | Experimentation | Machine LearningMid-level Full TimeSeattle, Washington, United States1d ago
-
Data Science Manager - TikTok Ads USD 153K-296KData Analysis | Data Modeling | Data pipeline | ETL | ExperimentationMid-level Full TimeSan Jose, California, United States1d ago
-
Computer Vision | Cross-lingual modeling | Data Curation | Machine Learning | Model DeploymentMid-level Full TimeSan Jose, California, United States1d ago
-
Applied AI Transformation Manager USD 160K-210KAnalytics | Artificial Intelligence | Delivery Model | Enterprise program management | Operating ModelMid-level Full TimeSan Francisco1d ago
-
Business Analytics Manager- PAI USD 49K-94KData Mining | Data Visualization | Descriptive Statistics | Forecasting | Inferential Statistics401k match | Fitness centers | Free vision coverage | Life insurance | Nine paid holidaysMid-level Full TimeColumbia, South Carolina, United States1d ago
-
Manager, Data Engineering USD 111K-185KADR | AWS | Analytics infrastructure | Azure | Bicep401k retirement plan | Bereavement leave | Dental insurance | Health insurance | Hybrid work optionMid-level Full TimeCarmel, IN - 11799 N College … R1d ago
-
Data Science Research Manager - Accenture Research USD 80K-266KA2A | Agent Orchestration | Agentic AI | BigQuery | Cloud Computing401k plan | Bonus opportunities | Dental insurance | Life insurance | Long-term disabilityMid-level Full TimeNew York, One Manhattan West, Corp, … R1d ago
-
Associate Director, Data & AI Governance USD 143K-286KAI Act | AI compliance | AWS | Alation | Artificial IntelligenceLong-term disability | Medical/Dental/Vision | Paid Holidays | Paid personal leave | Paid sick daysMid-level Full TimeCAFLO: Carrier-Home Florida Remote Location, Remote … R1d ago
-
Manager, HPC/AI Software Product management USD 144K-273KArtificial Intelligence | Business acumen | Coaching | Cross-Functional Collaboration | Cross-functionalHealth and wellbeing benefits | Hybrid work schedule | Personal and professional development programsMid-level Full TimeSpring, Texas, United States of America1d ago
-
Enterprise Marketing Technologies & Analytics Manager USD 107K-200KArtificial Intelligence | Attribution Modeling | Automation | CCPA | Consent Management401k match | Disability insurance | Employee stock purchase plan | Healthcare benefits | Life insuranceMid-level Full TimeLargo, FL, United States1d ago
-
Senior Manager, Fraud Analytics & Operations USD 70K-92KAccount takeover | Data Analysis | False Positives | Fraud Detection | Fraud RulesHealth and wellness benefits | Hybrid work model | Retirement savings plan | Work-life balanceSenior-level Full TimeMalvern, PA, United States1d ago