Senior Product Manager, LLM Post-Training & Evaluation
Remote Work( USA), United States
R
USD 160K-170K Senior-level Full Time
Tasks
- Create customer facing product narratives and technical collateral
- Define and track product KPIs for adoption quality and satisfaction
- Define evaluation benchmarks and evaluation as a service
- Design human in the loop evaluation workflows
- Lead go to market positioning packaging and pricing
- Own product strategy and roadmap for LLM post training and evaluation
- Partner with research and engineering to deliver product to production
- Translate customer requirements into product specifications
Perks/Benefits
- N/A
Skills/Tech-stack
AI Feedback | API Design | Agentic Evaluation | Benchmarking | Context evaluation | Data Contracts | Direct Preference Optimization | Fine Tuning | Go-to-Market Strategy | Go-to-market | Governance | Human Feedback | Human evaluation | Human-in-the-loop | Hybrid Evaluation | Language Models | Large Language Models | Learning from Human Feedback | Long Context | Long Context Evaluation | Machine Learning | Market Strategy | Model Evaluation | Model as judge | Multimodal evaluation | Platform APIs | Policy Optimization | Preference optimization | Product Roadmapping | Proximal Policy Optimization | Reinforcement Learning | Reinforcement Learning from AI Feedback | Reinforcement Learning from Human Feedback | Requirements Engineering | Responsible AI | Supervised Fine Tuning | The Loop
Education
Roles
Related jobs
-
Data Science Manager, Growth USD 210K-316KCausal analysis | Cumulative Impact Measurement | Data Architecture | Data Science | Experimentation401k plan | Company bonus | Dental insurance | Equity | Medical insuranceMid-level Full TimeSeattle, WA OR New York, NY … R19h ago
-
A/B | A/B Testing | Algorithms | B testing | Data Pipelines401k match | Child care benefits | Family building benefits | Lyft Pink membership | Lyft creditsMid-level Full TimeSeattle, WA R21h ago
-
A/B | A/B Testing | Algorithms | B testing | Data Pipelines401k plan | Child care benefits | Family building benefits | Lyft Pink membership | Medical/Dental/Vision insuranceMid-level Full TimeNew York, NY R21h ago
-
A/B | A/B Testing | B testing | Data Analysis | Data Pipelines401k plan | Child care benefits | Commuter benefits | Dental insurance | Family building benefitsMid-level Full TimeSan Francisco, CA R21h ago
-
Manager - Data , Analytics, & AI USD 110K-180KA/B | A/B Testing | AI Governance | AWS | B testing401k matching | Employee assistance program | Employee stock purchase plan | Health insurance | Healthcare FSAMid-level Full Time500 Woodward Avenue, MI, 601 S. … R1d ago
-
Strategic AI Lead USD 150K-210KAgile | Confluence | Data Quality | Data Visualization | Data labeling401k matching | Medical/Dental/VisionSenior-level Full TimeNew York City, NY (Hybrid); Redwood … R1d ago
-
Total Rewards Systems & Analytics Senior Manager USD 116K-210KAnalytics | Artificial Intelligence | Automation | Data Governance | GovernanceSenior-level Full Time6314 Remote/Teleworker US, United States R1d ago
-
Senior Manager, Machine Learning USD 151K-265KAWS | Agentic AI | Algorithms | Cloud platform | Data StructuresSenior-level Full TimeSan Jose, United States R1d ago
-
Cons - TC - AI and Data - Enterprise Data - Data Science - Manager - Multiple Positions - 1703364 USD 173K-173KAPIs | AWS | Amazon S3 | Azure Blob | Azure Blob Storage401k plan | Dental coverage | Flexible vacation policy | Hybrid work model | International travel opportunityMid-level Full TimeChicago, IL, US, 60607 R1d ago
-
Agency Data & Analytics Senior Manager (Hybrid) USD 113K-194KAI analytics | Business Intelligence | Cloud Migration | Cross-functional | Cross-functional leadership401k contribution | Annual incentive | Hybrid work | Medical, dental, vision benefits | Paid HolidaysSenior-level Full TimeAF-WI Madison Natl HQ, United States R1d ago
-
Manager, Data Science - Ads USD 432K-675KDashboards | Data Modeling | Data Visualization | ETL | Experimentation401k match | Health insurance | Life and disability benefits | Mental health support | Paid time offMid-level Full TimeIllinois - Remote, United States R1d ago
-
Agentic Systems | Continuous Improvement | Deep learning | Language Models | Language Processing401k match | Disability programs | Family-forming benefits | Flexible spending account | Flexible time offSenior-level Full TimeUSA - Remote, United States R1d ago
-
Circuit design | Classical simulation | Cloud Computing | Co-design | Complexity TheoryHealth benefits | Performance-Based Incentives | Remote eligible | Sponsorship for employment authorizationSenior-level Full TimeMcLean, VA, United States R1d ago
-
Data Analyst - Global Growth Luxury Strategy USD 99K-123KData Automation | Data Modeling | Data Visualization | Experiment measurement | Machine Learning401k match | Child care benefits | Dental insurance | Family building benefits | Lyft Pink membershipMid-level Full TimeSan Francisco, CA R1d ago
-
Analytics Manager, Credit Risk USD 191K-215KCredit Risk | Machine Learning | Python | SQL | UnderwritingESPP | Flexible spending wallets | Health care coverage | Remote-first | Time offMid-level Full TimeRemote US R1d ago
-
Associate Product Manager -Data Platform USD 135K-165KAPI Design | Agile | Backlog Management | Cause analysis | ComplianceMid-level Full TimeSan Francisco, NYC, Boston, or Remote R1d ago
-
Data Engineering Manager (remote) USD 87K-110KAgile | BigQuery | Data Governance | Data Modeling | Data Quality401k match | Employee assistance program | Employee stock purchase plan | Flexible schedules | Health insuranceMid-level Full TimeWork From Home, United States R2d ago
-
Senior Program Manager, Data & AI USD 173K-220KAWS | Agile | Analytics | Budgeting | Change ControlAutonomy | Coaching and Mentorship | Hybrid work arrangement | Inclusive culture | Remote work opportunitySenior-level Full TimeUS - Remote R2d ago
-
Senior Editorial Manager, US Analytical Content USD 109K-230KAnalytics | Artificial Intelligence | Content Quality | Content quality management | Data VisualizationHealth and wellbeing initiatives | Shared parental leave | Study assistanceSenior-level Full TimeHome based-Virginia, United States R2d ago
-
Associate Director, Workplace/FM Data Science Manager USD 173K-272KAPI | API Integration | AWS | Azure | Cloud ArchitectureDental insurance | Hybrid work | Medical insurance | Paid Holidays | Retirement benefitsMid-level Full TimeUSA - New Jersey - Rahway, … R2d ago
-
Consulting - TC - AI and Quant Modelling - AI Data Sci - Manager - Multiple Positions - 1702999 USD 163K-163KAgile | Apache Spark | Azure DevOps | Big Data | CI/CD401k plan | Dental coverage | Flexible vacation policy | Hybrid work | Medical coverageMid-level Full TimeDallas, TX, US, 75219 R2d ago
-
Senior Editorial Manager, US Analytical Content USD 109K-230KArtificial Intelligence | Change Management | Content Management | Data Visualization | Data analyticsShared parental leave | Study assistance | Wellbeing initiativesSenior-level Full TimeHome based-Virginia, United States R2d ago
-
Customer Success Engineer USD 125K-180KAI Application Lifecycle Management | AI application | AI application lifecycle | AI model | AI model architectureBackground check requirement | Flexible time off program | Global Employee Assistance Program EAP | Medical/Dental/Vision insurance | Paid HolidaysMid-level Full TimeRemote TX, United States R2d ago
-
Senior Product Manager - Applied AI (Remote Eligible) USD 148K-176KAI | Agent architecture | Enterprise Software | Enterprise software delivery | Evaluation infrastructure401k match | Flexible time off | Life insurance | Long-term disability | Medical, dental, and vision coverageSenior-level Full Time-REMOTE, USA- R2d ago
-
Lead Product Manager, AI & Data USD 175K-233KAgile | Analytics | Artificial Intelligence | Backlog Management | Change ManagementRemote work | Travel as neededSenior-level Full TimeUS-Remote R3d ago