Senior Technical Product Manager, AI Agents & Systems

Tasks

• Define end to end AI system requirements
• Define evaluation frameworks offline metrics online experiments human feedback
• Drive execution with technical specs and prioritization
• Ensure safe reliable shipping with feedback loops
• Make trade offs across quality latency cost reliability UX
• Own product quality correctness predictability user trust
• Partner on system design and evaluation
• Translate model capabilities into product decisions

Perks/Benefits

• N/A

Skills/Tech-stack

A/B | A/B Testing | Algorithms | Artificial Intelligence | B testing | Data Analysis | Data Structures | Experimentation | Human Feedback | Language Models | Language Processing | Large Language Models | Machine Learning | Model Evaluation | Natural Language | Natural Language Processing | Prompt engineering | System design