Product Owner, AI Email App

Tasks

• Collaborate on system design and evaluation
• Define and evolve evaluation frameworks
• Define end to end AI product requirements
• Drive execution through specifications and prioritization
• Establish quality bars and feedback loops
• Identify AI failure modes and ensure predictable behavior
• Make trade offs across quality latency cost reliability safety UX
• Own product quality correctness reliability usefulness and user trust
• Translate model evaluation results into product decisions

Perks/Benefits

• N/A

Skills/Tech-stack

A/B | A/B Testing | B testing | Cost Optimization | Evaluation metrics | Experiment design | Experimentation | Human Feedback | Language Models | Large Language Models | Latency optimization | Machine Learning | Prompting | Reliability Engineering | Safety engineering | System design | User Experience