AI QA Trainer - LLM Evaluation
Tasks
- Analyze model failures and provide improvement recommendations
- Assess safety and reliability
- Automate testing with Python and SQL
- Collaborate on evaluation metrics dashboards and quality monitoring
- Design test plans and evaluation frameworks
- Detect hallucinations and factual errors
- Develop evaluation rubrics and quality benchmarks
- Document findings and root cause analysis
- Evaluate bias and compliance risks
- Evaluate large language models
- Perform adversarial testing and red teaming
- Run regression suites
- Verify grounding retrieval augmented generation and tool usage
Perks/Benefits
Skills/Tech-stack
Adversarial Testing | Bias Assessment | Experiment tracking | Hallucination detection | LLM Evaluation | Language Models | Large Language Models | Machine Learning | Prompt engineering | Python | Quality Assurance | RAG | Red Teaming | Regression testing | Retrieval-Augmented Generation | Robustness Testing | SQL | Software testing | Test automation | Tool usage
Education
Roles
AI | AI QA | AI QA Engineer | Engineer | Learning Engineer | Machine Learning Engineer | QA Engineer
Related jobs
-
Manager Data Engineer EUR 60K-74KAmazon Web Services | Apache Spark | Azure | Azure Data | Azure Data FactoryBuddy support | Cafeteria plan | Career development | Charging card | Company carMid-level Full TimeEurope, Belgium, Brussels Office - Zaventem … R1d ago
-
Alerting | Amazon Aurora | Amazon Aurora PostgreSQL | Amazon Redshift | Anomaly DetectionFully remoteSenior-level Full TimeBelgium R4d ago
-
Senior Data Engineer EUR 54K-76KApache Airflow | BigQuery | Cloud platform | Containerization | DBTHybrid workSenior-level Full TimeBrussels, Belgium R8d ago
-
Analytics Engineer EUR 52K-78KAWS | Agentic AI | DBT | Dagster | Data ArchitectureEco vouchers | Employee discounts | Group insurance | Hospitalization insurance | LaptopMid-level Full TimeMechelen, Belgium R15d ago
-
AI Solutions Engineer EUR 55K-75KAI orchestration | Agent Frameworks | Agentic Automation | Evaluation | Language ModelsClient-facing exposure | Hybrid work | Learning and developmentSenior-level Full TimeAntwerp, Belgium R29d ago
-
AWS | Azure Policy | Azure Synapse | Cloud Data | Cloud Data PipelinesRemote workSenior-level Full TimeBruges, Belgium R1mo ago
-
Sr AI Engineer | Remote - Europe | TS/Vue/NodeJS GBP 80K-120KAPI Design | Agent architecture | Anthropic | Chat completion | Chunking401k match | Course budget | Dental coverage | Equity | HackathonsSenior-level Full TimeBerlin Office R1mo ago