Senior Manager, Data Quality & Evaluation
Tasks
- Analyze root causes of quality variation
- Build golden datasets and scorecards
- Coach and develop quality operations teams
- Define AI data evaluation frameworks
- Design QA sampling and calibration processes
- Develop rubrics and reviewer guidelines
- Drive annotation and evaluation quality workflows
- Lead multilingual speech audio evaluation operations
- Monitor quality indicators and error trends
- Set quality standards and acceptance criteria
- Support customer quality reviews and escalations
- Turn quality insights into process improvements
Perks/Benefits
- Flexible work location
- Fully remote
- Influence over quality strategy
- International team collaboration
- Professional growth opportunities
Skills/Tech-stack
Adjudication | Audio evaluation | Calibration | Dashboards | Data Annotation | Data Quality | Error Analysis | Evaluation | Human-in-the-loop | LLM Evaluation | Multilingual Evaluation | Performance reporting | Quality Assurance | RLHF | Reviewer Training | Rubrics | Sampling strategy | Scorecards | Speech Recognition | The Loop | Transcription
Education
N/A
Roles
Data Quality | Data Quality Manager | Manager | Quality Manager | Senior Manager
Related jobs
-
GenAI Account Manager CAD 85K-95KAccount Management | Brand safety | Client Services | Compliance | Content provenanceMid-level Full TimeToronto, Canada R4d ago
-
Automation | Big Data | CI/CD | Cloud infrastructure | Cloud platformFlexible location | Remote-first work environment | Work-life balance cultureExecutive-level Full TimeCanada R6d ago
-
Attribution Modeling | Brand Analytics | Cloud Computing | Conversion Tracking | Conversion measurementAnnual product gift card | Company-matched RRSP | Dedicated break period | Employer paid medical dental and vision | Family building and fertility supportSenior-level Full TimeCanada R7d ago
-
Data Engineer CAD 95K-130KAI Governance | API Integration | Artificial Intelligence | Cloud Platforms | EvaluationEmployee and family assistance program | Flexible scheduling | Flexible vacation | Health insurance | Long-term disabilitySenior-level Full TimeCanada - Remote R7d ago
-
Manager, Analytics Engineering CAD 170K-200KCI/CD | DBT | Data Cataloging | Data Governance | Data ModelingCharitable donation match | Dental insurance | Flexible time off | Health insurance | Paid certification supportMid-level Full TimeRemote - Ontario, Canada R13d ago
-
Dashboard Optimization | Data Cleansing | Data Governance | Data Privacy | Data QualityFlexible work arrangement | Free fitness membership | Fun and Energetic Atmosphere | Group Health Care Plans | Ongoing training and developmentMid-level Full Time0990 Home Office, Canada R25d ago
-
Senior Manager, Data Science CAD 120K-150KArtificial Intelligence | Attribution | Calibration | Data Fusion | Data MiningDiscount program | Education reimbursement | Health and dental | Hybrid work | Leadership trainingSenior-level Full TimeToronto, ON - Remote R29d ago
-
CAN SPAM Act | CAN-SPAM | CCPA | CRM | ComplianceHybrid scheduleSenior-level Full TimeCalgary, Alberta, Canada R1mo ago
-
Media Analytics Manager, Measurement & Attribution CAD 140K-148KA/B | A/B Testing | AI Driven | AI-driven Automation | Ad AuctionAnnual refresh grants | Equity grant | Flexible work location | Health benefits | Remote work flexibilitySenior-level Full TimeCanada - Remote (ON, AB, BC, … R1mo ago