Senior Manager, Data Quality & Evaluation

Tasks

• Build calibration QA sampling adjudication processes
• Coach and develop quality managers leads specialists reviewers and contributors
• Convert quality insights into actionable process improvements
• Define quality standards acceptance criteria review processes performance metrics
• Design quality frameworks for AI data and evaluation programs
• Develop rubrics task instructions reviewer guidelines calibration golden datasets scorecards reporting templates
• Lead quality operations for multilingual evaluation speech and audio transcription annotation
• Lead quality reviews customer escalations retrospectives improvement plans
• Monitor quality indicators reviewer agreement error trends root causes
• Translate customer requirements into quality workflows

Perks/Benefits

• Flexible work location
• Fully remote
• International team collaboration
• Leadership influence on quality strategy
• Professional growth opportunities

Skills/Tech-stack

Adjudication | Annotation Guidelines | Calibration | Cause analysis | Dashboards | Data Annotation | Data Quality | Error Analysis | Evaluation Frameworks | Human-in-the-loop | Multilingual Evaluation | Performance Metrics | QA Sampling | Quality Assurance | Quality management | Reporting | Reviewer Training | Root Cause Analysis | Root cause | Scorecards | Speech Processing | The Loop | Transcription