Technical Product Manager, AI Inference & Software
Tasks
- Coordinate with ecosystem partners
- Create competitive briefings
- Create scope and feasibility frameworks
- Define feature modes and deprecation policy
- Define inference software stack requirements
- Define software product lifecycle
- Document internal and customer facing products
- Feed customer needs into roadmap
- Manage versions and release trains
- Own AI inference software product planning end to end
- Partner with engineering and GTM to build roadmap
- Streamline product planning with agentic AI
- Track model and inference system frontier
- Translate model frontier into engineering requests
Perks/Benefits
- 13 Paid Company Holidays
- 401K company matching
- Company paid life and disability coverage
- Company provided computer and home office setup
- Fully company paid medical dental and vision
- Real time to rest support future
- Remote-first culture
- Supplemental hospital critical illness and accident coverage
- Unlimited paid time off
Skills/Tech-stack
Agentic AI | Attention | Automation | Batching | Benchmarking | Inference Serving | KV cache | Language Model | Large Language Model | Latency SLAs | Machine Learning | Mixture of Experts | Model Ingestion | Multi-tenancy | Observability | Open Source | Performance Analysis | Quantization | SGLang | Scheduling | TPOT | TTFT | Tokens Per Dollar | Tokens per watt | Transformer | VLLM
Education
N/A
Roles
Related jobs
-
Data Analytics Manager USD 105K-135KAPIs | Analytics | Anomaly Detection | Automation | DashboardingHybrid work | Inclusion and collaboration culture | Onsite three days per weekMid-level Full TimeMadhive HQ (New York, NY) R23h ago
-
Head of Data Engineering & Platform CAD 289K-362KData Governance | Data Modeling | Data Quality | Data Storage | Data orchestrationExecutive-level Full TimeSan Francisco, CA, New York, NY, … R1d ago
-
Bayesian Inference | Causal Effects | Causal Effects Modeling | Causal Inference | Data Ingestion401k match | Adoption benefits | Back up child care support | Charitable giving grant | Commuter parking stipendMid-level Full TimeSan Francisco, CA R1d ago
-
Manager, Software Engineering - Data Platform USD 258K-376KBatch Processing | Cross-Functional Collaboration | Cross-functional | Data Infrastructure | Data platformMid-level Full TimeSan Francisco, CA • New York, … R1d ago
-
Digital Lead, Clinical Analytics USD 125K-165KAI Ready | AI-Ready Data | Analytics Platforms | Business Intelligence | Computerized SystemHybrid work | Innovation-driven culture | Vendor managed technology supportSenior-level Full TimeRaleigh, North Carolina, United States R1d ago
-
Principal Product Manager, GenAI Landscape Intelligence USD 194K-282KBenchmarking | Competitive Analysis | Data Analysis | Generative AI | Market ResearchSenior-level Full TimeSan Francisco, United States R1d ago
-
Staff Product Manager - AI (Data & Analytics) USD 180K-210KA/B | A/B Testing | APIs | Agentic AI | AnalyticsSenior-level Full TimeAtlanta, GA R1d ago
-
Alerting | Bioinformatics | Cause analysis | Change Control | Data Analysis401k | Baby bonding leave | Commuter benefits | Dental insurance | Disability insuranceMid-level Full TimeUS Remote R1d ago
-
Senior Product Manager - Agent Integrations USD 192K-240KAI Agents | AI integration | Backlog Management | BentoML | Cross-functionalEmployee stock purchase plan | Hybrid workplace | Inclusion resource groups | Mental health benefits | Mentor/Buddy programSenior-level Full TimeNew York, New York, USA R2d ago
-
Product Owner, AI Internal Systems USD 110K-160KAPIs | Artificial Intelligence | Automation | Cloud infrastructure | Database systemsEntry-level Full TimeUnited States R2d ago
-
Manager of Machine Learning - AI Modeling and Operation USD 163K-290KAWS | AWS Bedrock | Airflow | Azure | Azure OpenAI401-k match | Comprehensive employee benefits | Discretionary bonus | Restricted stock unitsMid-level Full TimeRemote - IA, United States R2d ago
-
Manager, Data Science USD 94K-125KA/B | A/B Testing | Attribution Modeling | B testing | Data Modeling401k | Flexible paid time off | Life insurance | Long-term disability insurance | Medical, dental, and vision insuranceMid-level Full TimeNew York - 150 E 42nd, … R2d ago
-
Senior Manager, Agentic AI Integrations USD 146K-230KA2A | AI/ML | AI/ML Platform | AI/ML platform engineering | API GovernanceHealth and wellbeing resources | Paid volunteer daysSenior-level Full TimeMountain View - United States or … R2d ago
-
AI literacy | Agile | Artificial Intelligence | Audit Readiness | AutomationSenior-level Full TimeDayton WFH, United States R2d ago
-
Senior Manager, Analytical AI Clinical Development USD 152K-202KAWS | Airflow | Azure | CI/CD | Dagster401k plan | Employee assistance program | Employee wellbeing programs | Flexible work arrangements | Health coverageSenior-level Full TimePrinceton Pike - NJ, United States R2d ago
-
Data Engineering Manager USD 133K-198KAWS | Apache Spark | Automated testing | Azure | Azure EventRelocation benefitsSenior-level Full TimeAustin Technical Center - Austin Technical … R2d ago
-
Manager, ECM Ops & Analytics USD 104K-130KData Standardization | Data Visualization | Excel | Forecasting | Performance AnalysisEmployee wellbeing programs | Healthcare coverage | Paid learning opportunitiesMid-level Full TimeVirtual, USA, United States R2d ago
-
Principal, Analytics Transformation & AI Enablement USD 110K-220KArtificial Intelligence | Change Management | Cloud Computing | Communication | Data EngineeringAdoption Assistance | Backup dependent care | Behavioral health solutions | Employee resource groups | Family building supportSenior-level Full TimeUSA - PA - Remote, United … R2d ago
-
Product Manager, Applied AI (Staff / Senior Staff) USD 230K-300KAgentic Systems | Artificial Intelligence | Data Flywheel | Data Modeling | Error Analysis401k savings plan | Commuter benefits | Daily in-office meals | Healthcare FSA | Healthcare coverageSenior-level Full TimeNew York City, NY R2d ago
-
Analytics | Benchmarking | Budgeting | Counterfactual Modeling | Data LineageFlexible work schedule | Remote workSenior-level Full TimeWork From Home - United States, … R3d ago
-
Senior-level Full TimeBoston R3d ago
-
Applied AI Architect, Enterprise Tech USD 240K-315KAPI Integration | Cloud Architecture | Data Science | Enterprise Integration | LLM EvaluationFlexible working hours | Generous vacation | Hybrid work policy | Optional equity donation matching | Parental leaveSenior-level Full TimeSan Francisco, CA | New York … R4d ago
-
Staff Data Architect USD 157K-192KBatch Processing | Cloud modernization | Cloud platform | Data Architecture | Data Contracts401k match | Dental insurance | Financial wellness | Health insurance | Hybrid workSenior-level Full TimeChicago, IL 60607, United States R4d ago
-
AI-assisted workflows | Annotation Schema | Automated QA | Data Operations | Data QualityEquity compensation | Health benefits | Remote workSenior-level Full TimeSan Mateo, CA, United States R4d ago
-
Head of Applied Machine Learning USD 292K-343KData Science | Embeddings | Evaluation metrics | Experimentation | Feature EngineeringInclusive work environment | Professional growth and mentorshipExecutive-level Full TimeUnited States - Remote R4d ago