AI QA Trainer - LLM Evaluation
United Arab Emirates
R
A AED 286K-349K (estimate) Senior-level Contract Full Time
Tasks
- Analyze model behavior document failures and root cause analysis
- Automate testing using Python or SQL
- Collaborate on evaluation metrics dashboards and quality monitoring
- Design and execute test plans regression suites evaluation frameworks
- Develop evaluation rubrics pass fail criteria quality benchmarks
- Evaluate large language models across accuracy reasoning safety reliability
- Maintain documentation of findings and reproducible issue reports
- Perform adversarial testing red teaming robustness evaluations
- Verify grounding retrieval augmented generation output tool usage accuracy workflow reliability
Perks/Benefits
- Access to advanced AI systems
- Flexible contract opportunity
- Fully remote flexibility to contribute from anywhere
Skills/Tech-stack
Adversarial Testing | Bias Assessment | Experiment tracking | Hallucination detection | LLM Evaluation | Machine Learning | Prompt engineering | Python | Quality Assurance | Red Teaming | Regression testing | Retrieval-Augmented Generation | SQL | Safety testing | Test automation
Education
Roles
AI | AI QA | AI QA Trainer | QA Trainer | Trainer
Related jobs
-
Applied AI Specialist AED 216K-300KAPI | Anomaly Detection | Cloud Architecture | Computer Vision | Data GovernanceContinued career development support | Employee resource groups | Flexible work-from-home policy | Generous paid time off | Paid volunteer timeSenior-level Full TimeUAE-Dubai, United Arab Emirates R3d ago
-
LLM - AI Quality Analyst (Personalization) - Hindi AED 200K-200KAI quality | AI quality evaluation | Content Moderation | Data Annotation | Data HygieneFlexible schedule | Remote workMid-level ContractInternational R3d ago
-
Senior AI Solutions Engineer - UAE AED 286K-360KAI Evaluation | AI Observability | AI tracing | APIs | Agent OrchestrationDental insurance | Employee assistance program | Flexible time off | Medical insurance | Paid HolidaysSenior-level Full TimeRemote Dubai, United Arab Emirates R11d ago