Senior AI Agent Evaluation Engineer

United Kingdom - Remote R

USD 100K-100K Senior-level Full Time

@ M...

Apply Save

Found 1d ago

Tasks

Analyze agent failures
Build virtual developer environments
Define solved criteria for AI agent
Design evaluation tasks from intermediate states
Iterate tasks and tests from QA feedback
Refine evaluation criteria
Verify agent solutions
Write functional tests
Write integration tests

Perks/Benefits

Skills/Tech-stack

Education

N/A

Roles

Regions

Europe

Countries

United Kingdom

Apply Save

Language: en Views:

0 Clicks:

0 Saves: 0

Related jobs

Data Engineer GBP 60K-74K

Automated testing | DBT | Data Vault | Data Warehouse | Dataform

Dental insurance allowance | Flexible working | Gym membership allowance | Holiday 25 days plus Bank Holidays | Learning and development budget

Senior-level Full Time

London, England, United Kingdom R

1d ago
Senior AI Agentic Developer |Hybrid | London | Salary in Euros A GBP 70K-100K

A/B | A/B Testing | API Management | AWS Bedrock | Apigee

Senior-level Full Time

London, United Kingdom R

1d ago
Markets Data Engineer GBP 53K-76K

Dashboards | Data Modeling | Data Visualization | Financial markets | Pandas

Annual leave | Bank holidays | Employee assistance | Flexible benefits scheme | Hybrid working

Entry-level Full Time

London, United Kingdom R

1d ago
Markets Data Scientist GBP 60K-86K

Amazon Redshift | Data Visualization | ETL | Feature Engineering | Interactive dashboards

Employee assistance program | Flexible benefits | Hybrid work model | Income protection | Life assurance

Mid-level Full Time

London, United Kingdom R

1d ago
Software Engineer - Analytics Hub GBP 91K-110K

AWS | Agile | Artificial Intelligence | Node.js | React

Hybrid work model | Mentorship culture | Remote work flexibility

Senior-level Full Time

London, United Kingdom R

4d ago
Senior Machine Learning Engineer GBP 78K-109K

A/B | A/B Testing | B testing | Clustering | Docker

Dental insurance allowance | Flexible working | Gym membership allowance | Inclusion groups | Learning and development budget

Senior-level Full Time

London, England, United Kingdom R

4d ago
Junior Data Engineer GBP 30K-40K

Apache Airflow | Apache Spark | Data Governance | Data Modeling | Data Processing

Growth plan | Gym discounts | Learning resources | Mental health support | Mentorship

Entry-level Full Time

London R

4d ago
DataOps Engineer GBP 50K-60K

AWS | Ansible | Bash | Docker | ELT

Flexible working hours | Remote work option | Team collaboration

Mid-level Full Time

United Kingdom R

4d ago
Senior AI Engineer, AI Lab GBP 90K-131K

BLEU | Bark | DVC | ElevenLabs | Fine Tuning

Annual leave | Employee assistance program | Free Economist content online subscription | Moving home allowance | Parental leave

Senior-level Full Time

London - Commercial R

4d ago
AI/ML - Platform Engineering, Vice President GBP 200K-280K

API Design | Agile | Cloud Computing | Distributed Systems | Fine Tuning

Education reimbursement | Family support programs | Flexible time off | Health and wellness benefits | Hybrid work model

Executive-level Full Time

ED3 - 20 Brandon Street, Edinburgh, … R

4d ago
Data Engineer GBP 80K-80K

AWS ECS | Amazon S3 | Apache Iceberg | DBT | Dagster

Flexible working | Home office setup | Income protection | Nursery salary sacrifice scheme | Private health insurance

Senior-level Full Time

United Kingdom - Remote R

4d ago
Lead Data & AI Platform Engineer (Remote, United Kingdom) GBP 70K-90K

Apache Spark | Automated testing | BI Dashboards | CI/CD | Data Governance

Permanent contract | Remote work

Senior-level Full Time

Work From Home - UK, United … R

4d ago
Machine Learning Manager, Borrowing GBP 100K-160K

AI Platform | AWS | BigQuery | Cloud platform | Credit Risk

Equipment provided | Flexible working hours | Learning budget | Relocation support | Visa sponsorship

Mid-level Full Time

Cardiff, London or Remote (UK) R

5d ago
Senior Solutions Engineer - Qatar & S.Africa Fly-in GBP 74K-103K

AI Agents | AWS | Apache Spark | Apache Spark architecture | Artificial Intelligence

Hybrid schedule | Travel opportunities | Workshops and community engagement

Senior-level Full Time

London, United Kingdom R

5d ago
Principal Data Engineer (Product Data) GBP 85K-103K

Amazon Kinesis | Apache Kafka | CI/CD | DBT | Data Contracts

Career growth development programs | Collaborative culture | Flexible time off plans | Flexible work schedules | Health and wellness benefits

Senior-level Full Time

Antrim, Northern Ireland, United Kingdom; Remote- … R

6d ago
Principal Data Engineer GBP 90K-103K

CI/CD | CRM | DBT | Data Contracts | Data Ingestion

Career growth development programs | Flexible time off | Flexible work schedules | Health and wellness benefits

Senior-level Full Time

Antrim, Northern Ireland, United Kingdom; Remote- … R

6d ago
Senior Analytics Engineer GBP 85K-105K

Data Governance | Data Modelling | Data Quality | Data Security | Data Warehouse

Allocated learning and development budget | Enhanced parental leave | Flexible benefits | Free meals and snacks | Prayer meditation and breastfeeding room

Senior-level Full Time

London (Shoreditch) R

6d ago
Senior Agentic AI Engineer GBP 80K-100K

Agentic AI | BrightScript | C plus plus | Evaluation | Function Calling

Financial wellness resources | Flexible remote work Fridays | Hybrid work arrangement | Mental health support

Senior-level Full Time

Cambridge, United Kingdom R

6d ago
Data Engineer GBP 49K-50K

AWS | CloudWatch | DBT | Data Lakehouse | ETL

Hybrid work | Inclusive culture | Professional development | Remote flexibility | Supportive leaders

Mid-level Full Time

London - Tower Place West, United … R

6d ago
Computer Science Expert with Python Experience - AI Projects on Mindrift USD 100K

C# | MATLAB | NumPy | Pandas | Python

Flexible part-time hours | Paid per hour equivalent | Project based work

Senior-level Full Time

United Kingdom - Remote R

6d ago
Chemistry & Python Expert - Freelance AI Trainer USD 70K

Autodock Vina | Basis set | Cheminformatics | Convergence thresholds | Docker

English CV required for submission | Freelance project-based work | Part-time flexible schedule

Senior-level Freelance

United Kingdom - Remote R

6d ago
Data Engineer GBP 80K-105K

AWS | Airflow | Data Architecture | Data Ingestion | Data Transformation

Cycle to work scheme | Enhanced parental leave | Holidays | Hybrid working | Learning and development budget

Senior-level Full Time

London, United Kingdom R

7d ago
Software Engineer (Inference Platform) GBP 80K-127K

Alerting | Asynchronous programming | CI/CD | Continuous Deployment | Continuous integration

Hybrid working

Mid-level Full Time

London R

7d ago
Senior Data Engineer GBP 80K-103K

AWS | Apache Spark | Data Modeling | Data Monitoring | Data Quality

Dental insurance | Equity | Fully remote | Healthcare insurance | Learning and development stipend

Senior-level Full Time

United Kingdom / Netherlands - Remote R

7d ago
AI Engineering Team Lead GBP 70K-103K

API Development | Backend Development | Cloud Computing | Data Pipelines | Deployment

Engaging employee programs | Flexible time off policy | Life assurance | Pension | Private health coverage

Senior-level Full Time

United Kingdom Remote R

7d ago