Senior Manager, Data Quality & Evaluation
Tasks
- Build calibration sampling and adjudication processes
- Conduct error analysis and identify quality root causes
- Define quality standards and acceptance criteria
- Design quality frameworks for AI data and evaluation programs
- Develop quality rubrics guidelines and reporting templates
- Implement continuous improvement across instructions training tooling and workflows
- Lead coach and develop quality operations teams
- Lead quality operations for data collection annotation and evaluation
- Monitor quality indicators and performance metrics
- Run customer quality reviews escalations retrospectives and improvement plans
- Translate customer requirements into quality workflows
Perks/Benefits
Skills/Tech-stack
Adjudication | Annotation Guidelines | Calibration | Cause analysis | Data Quality | Error Analysis | Evaluation | Human-in-the-loop | Operational excellence | Performance Metrics | Process Improvement | Quality Assurance | Quality Scorecards | Quality management | Reviewer Training | Root Cause Analysis | Root cause | Rubrics Development | Sampling | The Loop
Education
N/A
Related jobs
-
Automation | Big Data | CI/CD | Cloud platform | Data ArchitectureFlexible location | International team collaboration | Leadership ownership | Remote-first | Work-life balanceExecutive-level Full TimeBrazil R6d ago
-
Data Analytics & AI Solutions Group Leader BRL 210K-210KAgentic AI | Agile | Automation | Data Engineering | Data GovernanceFlexible location | Remote workSenior-level Full TimeSao Paulo, SP, Brazil R8d ago
-
Engineering Manager BRL 108K-132KAWS | Acceptance Testing | Angular | Automation | CI/CDHybrid workMid-level Full TimeSão Paulo, SP, Brazil R1mo ago
-
Data & Analytics Manager, Finance BRL 137K-169KAlgorithms | Business Intelligence | Change Management | Data Modeling | Data QualityHybrid work modelMid-level Full TimeNon MDLZ building – Brazil R1mo ago
-
AI tools | Data Analysis | Data Quality | Geospatial Data | Product ManagementFully remoteMid-level Full TimeBrazil - Remote R1mo ago