Senior Manager, Data Quality & Evaluation
Tasks
- Coach quality managers and reviewers
- Conduct adjudication and reviewer performance tracking
- Define evaluation standards
- Design quality frameworks
- Develop rubrics and reviewer guidelines
- Drive quality process improvements
- Lead data quality human in the loop workflows
- Lead quality operations for multilingual evaluation
- Manage data collection and annotation quality
- Monitor quality indicators and error trends
- Perform calibration and QA sampling
- Perform root cause analysis
- Support customer quality reviews and escalations
- Translate customer requirements into quality workflows
Perks/Benefits
- Flexible work location
- Fully remote
- Influence on Quality Strategy
- International team collaboration
- Professional growth
Skills/Tech-stack
AI Evaluation | Adjudication | Audio evaluation | Calibration | Cause analysis | Coding Evaluation | Data Annotation | Data Operations | Error Analysis | Evaluation rubrics | Human-in-the-loop | LLM Evaluation | Multilingual Evaluation | Performance reporting | QA Sampling | Quality Assurance | Quality management | RLHF | Root Cause Analysis | Root cause | Speech Audio | Speech Audio Evaluation | The Loop | Transcription
Education
N/A
Roles
Data Quality | Data Quality Lead | Data Quality Manager | Lead | Manager | Quality Lead | Quality Manager | Senior Manager
Related jobs
-
Benchmarking | Context engineering | Cybersecurity | Deep learning | Evaluation FrameworksCareer growth | Equity package | Flexibility to work across Europe | Fully remoteExecutive-level Full TimeFrance R3d ago
-
AI Platform | Apache Spark | Data Migration | Databricks | Delta LakeSenior-level Full TimeRemote - France R18d ago
-
Data Quality Management H/F EUR 40K-40KAgile | Artificial Intelligence | Backlog Management | Cause analysis | DashboardingCulture Subsidy | Earning Time Account | Health insurance | Meal tickets | Mobility allowanceSenior-level Full TimeToulouse, 31, France R20d ago
-
AWS | Cause analysis | Collibra | Data Governance | Data MonitoringHybrid work | Provided equipment | Technical certifications | Training and developmentSenior-level Full TimeParis, Paris, France R25d ago
-
AWS | Cause analysis | Collibra | Data Governance | Data ManagementEmployee participation program | Hybrid work | Provided equipment | Training and developmentSenior-level Full TimeLille - Jardin des Plantes, Nord, … R1mo ago