Senior Technical Product Manager - AI Agents, Evals & Reliability
Tasks
- Collaborate on AI system design and evaluation
- Define end to end AI system requirements
- Define evaluation frameworks with offline online and human feedback
- Drive execution with specs and prioritization
- Ensure safe reliable product releases
- Own product quality for correctness predictability and user trust
- Perform trade offs across quality latency cost reliability and UX
- Translate model capabilities into product decisions
Perks/Benefits
- N/A
Skills/Tech-stack
A/B | A/B Testing | Algorithms | B testing | Cost Optimization | Data Pipelines | Data Structures | Human Feedback | Language Models | Large Language Models | Latency optimization | Machine Learning | Model Evaluation | Offline metrics | Prompt engineering | Quality Assurance | Reliability Engineering | System design
Education
N/A
Roles
Related jobs
-
Cost Optimization | Experimentation | Hallucination mitigation | Human Feedback | Language ModelsSenior-level Full TimeIndonesia R2d ago
-
Senior-level Full TimeIndonesia R2d ago
-
Artificial Intelligence | Cost Optimization | Experiment design | Experimentation | Human FeedbackMid-level Full TimeIndonesia R2d ago
-
Algorithms | Artificial Intelligence | Cost Optimization | Data Structures | Experiment designSenior-level Full TimeIndonesia R5d ago