Principal Product Manager, Inference Engine
Tasks
- Balance developer experience with infrastructure economics
- Create pricing and packaging strategy
- Define GPU deployment allocation pricing optimization
- Define operating metrics and track KPIs
- Drive inference product roadmap with engineering
- Make customer backed product decisions
- Maximize GPU utilization and margin
- Own GPU strategy for inference business
- Translate customer demand into infrastructure requirements
Perks/Benefits
Skills/Tech-stack
Autoscaling | Batching | Capacity Efficiency | Capacity Planning | GPU Economics | GPU capacity | GPU capacity planning | Gross Margin | Infrastructure economics | LLM Inference | Latency optimization | Model Serving | Model routing | Observability | Open Source | Open-source Models | Prompt Caching | Token Throughput
Education
N/A
Related jobs
-
Manager, Enterprise Data Engineering USD 180K-247KADLS | Active Directory | Agile | Apache Spark | Automated testing401k matching | Adoption Assistance | Childcare tuition discounts | Company bonus | Fertility benefitsSenior-level Full TimeAnn Arbor, MI, United States13h ago
-
Lead Principal Machine Learning Engineer USD 169K-355KAccess Control | Agent systems | AgentOps | Auditability | Autogen401k match | Life insurance | Paid Holidays | Paid parental leave | Paid sick leaveSenior-level Full TimeSan Francisco, CA, United States18h ago
-
Algorithms | Apache Airflow | Apache Flink | Apache Spark | C++Senior-level Full TimeUS-WA-Bellevue19h ago
-
Principal Data Engineer - FLINK USD 125K-180KAggregations | Alerting | Apache Flink | Back pressure | CI/CDSenior-level Full TimeUnited States23h ago
-
Datadog for Startups - Forward Deployed Engineering Lead USD 192K-240KAPM | AWS | Automation | Azure | CI/CD401k match | Dental benefits | Discounted employee stock purchase plan | Fitness reimbursements | Healthcare benefitsSenior-level Full TimeNew York, New York, USA1d ago
-
Senior Manager, Data Platform & Autonomy Infrastructure USD 225K-275KAutonomy | Data Engineering | Data Modeling | Data Pipelines | Data StorageDental insurance | Equity compensation | Health insurance | Paid time off | Performance bonusSenior-level Full TimeSouth San Francisco, California, USA1d ago
-
Senior-level Full Time100 New Millennium Way, Bldg 1, …1d ago
-
Senior AI/ML Engineer USD 107K-216KAWS | Analytics | Async I/O | Backpressure | CI/CDEducational assistance | Emotional well-being support | Employee match program | Health care coverage | Learning resourcesSenior-level Full Time245 Summer St, Boston MA, United … R1d ago
-
AWS Cloud | Agile | Amazon Web Services | Architecture | Automated testing401k retirement plan | Company match | Dental coverage | Flexible Spending Accounts FSA | Health Savings Account (HSA)Senior-level Full TimeSan Francisco, United States1d ago
-
Warehouse Operations and Analytics Manager USD 46K-46KAudit management | Capacity Planning | Compliance Management | Continuous Improvement | Data AnalysisSenior-level Full TimeUS OH Akron Corp Hdqtrs, United …1d ago
-
Best practices | Budget Management | Cross-Functional Collaboration | Cross-functional | Deliverable Management401k | Co working Benefit | Company offsite | Education and learning stipend | Health and dental benefitsSenior-level Full TimeCanada2d ago
-
Staff Software Engineer, AI/ML USD 186K-233KApache Iceberg | Capacity Planning | Cloud services | Competitive Analysis | Data ArchitectureConference reimbursement | Education reimbursement | Employee assistance program | Employee stock purchase program | Flexible time offSenior-level Full TimeSeattle2d ago
-
Principal Engineer, Data Engineering USD 129K-155KAPI | AWS | Agile | Azure | CI/CDHybrid work model | Life and disability benefits | Life insurance | Medical, dental, and vision insurance | Paid time offSenior-level Full TimeFL - Saint Petersburg - 880 …2d ago
-
AI machine learning | AI machine learning platforms | Call Management | Capacity Planning | Cause analysisHybrid work environment | Relocation available | Travel up to 25 percentMid-level Full TimeNew Orleans, Louisiana, United States2d ago
-
Principal AI Systems Engineer — C++ / Applied AI USD 190K-360KAI | AI orchestration | API Design | Agentic Workflows | Asynchronous programmingSenior-level Full TimeSan Jose, United States R2d ago
-
Data Science Senior Manager USD 244K-553KAWS | Agentic AI | Artificial Intelligence | Azure | CI/CDSenior-level Full TimeNewport Beach, CA, US, 926602d ago
-
Sr. Manager Data Science - Gen AI and Content Systems USD 118K-219KAWS | Azure | CI/CD | Containerization | Data Pipelines401k | Dental benefits | Flexible working hours | Health benefits | SabbaticalSenior-level Full TimeUSA - Raleigh, NC (RDU), United …2d ago
-
Senior Manager, Data Analysis USD 182K-208KData Governance | Data Technologies | Data analytics | Data sets | EconometricsMentorship | Training opportunities | Work-life balanceSenior-level Full TimePlano, TX, United States2d ago
-
Principal Engineer, Data Engineering USD 102K-170KAPI Management | Agile Development | Azure | CI/CD | Container DeploymentInclusive work environment | Mentorship | Remote work optionsSenior-level Full TimeUS017 NJ New Brunswick - 1 … R2d ago
-
Sr. Manager Data Science - Gen AI and Content Systems USD 118K-219KAWS | Automation | Azure | Benchmarking | CI/CD401(k) retirement benefits | Dental benefits | Flexible work hours | Health benefits | SabbaticalsSenior-level Full TimeUSA - Raleigh, NC (RDU), United …2d ago
-
Experimentation | Information Retrieval | Language Models | Language Processing | Large Language Models401k | Dental insurance | Employee discount | Health insurance | Life insuranceSenior-level Full Time100 Mathilda Place,Ste 100 Sunnyvale,CA 94086-6017, …2d ago
-
Senior Manager- AI Engineer USD 130K-260KAPIIntegration | APIs | AWS | Azure | AzureOpenAIDental coverage | Medical coverage | Paid time off | Retirement savings options | Vision coverageSenior-level Full TimeWork At Home-Connecticut, United States2d ago
-
Fulfillment Optimization Manager I USD 85K-127KCapacity Planning | Capacity modeling | Cause analysis | Chain management | Data AnalysisSenior-level Full TimeUnited States2d ago
-
Engineering Manager, Serverless Compute Platform USD 180K-225KAPI Design | AWS | Architecture Review | Azure | Call ManagementMid-level Full TimeBellevue, Washington2d ago
-
Senior Engineering Manager, Data & Cloud Platform USD 190K-210KAWS | Agent memory | CI/CD | Context Stores | DBT401k employer match | Career advancement | Employee assistance program | Employee recognition | Health, dental, vision insuranceSenior-level Full TimeRemote US R2d ago