Senior AI Agent Evaluation Engineer

United Kingdom - Remote R

USD 100K-100K Senior-level Full Time

@ M...

Apply Save

Found 1mo ago

Tasks

Analyze agent failures
Build virtual developer environments
Define solved criteria for AI agent
Design evaluation tasks from intermediate states
Iterate tasks and tests from QA feedback
Refine evaluation criteria
Verify agent solutions
Write functional tests
Write integration tests

Perks/Benefits

Skills/Tech-stack

Education

N/A

Roles

Regions

Europe

Countries

United Kingdom

Apply Save

Language: en Views: 4

Clicks: 3

Saves: 0

Related jobs

Software Developer, Data Platform GBP 55K-65K

Apache Flink | Apache Kafka | BigQuery | Cloud Spanner | Cloud platform

Hybrid work from home policy

Mid-level Full Time

Manchester, England, United Kingdom R

10h ago
Data Engineering Specialist GBP 70K-94K

Ab Initio | Amazon Kinesis | Apache Kafka | Apache NiFi | Apache Spark

Dental insurance | Discounted telecom products | Flexible hybrid working | Gym memberships | Holiday purchase scheme

Senior-level Full Time

Belfast, GB, BT1 3BT R

11h ago
Machine Learning Platform Engineer GBP 22K

Alerting | Benchmarking | Cloud infrastructure | Data Pipelines | Distributed Systems

Mid-level Full Time

United Kingdom R

14h ago
LLM Application Engineer GBP 100K-140K

API Integration | Context engineering | Distributed Systems | Evaluation | Experimentation

Mid-level Full Time

United Kingdom R

15h ago
AI Researcher GBP 58K-77K

Adversarial Robustness | Bias Assessment | CUDA | Computer Vision | Deep learning

Senior-level Full Time

Green Park, United Kingdom R

20h ago
Data Engineer GBP 45K-70K

AWS | Apache Airflow | Apache Spark | CI/CD | Cloud Computing

Insurance | Paid time off

Mid-level Full Time

Edinburgh / Hybrid R

1d ago
Data Engineer GBP 37K-45K

API Integration | AWS | AWS Glue | Amazon EMR | Amazon Redshift

Annual leave | Company pension scheme | Cycle to work | Hybrid working | Performance bonus

Mid-level Full Time

Bristol, England, United Kingdom R

1d ago
Research Artificial Intelligence (AI) Adoption Specialist GBP 78K-109K

Acceptance Testing | Artificial Intelligence | Data Analysis | Data Visualization | Language Processing

Bike4Work scheme | Flexible benefits | Gym benefits | Hybrid working | Life assurance

Mid-level Full Time

London, 21 Moorfields, United Kingdom R

1d ago
Factory Data Analytics Engineer USD 86K-165K

Angular | C Sharp | Database Design | JMP | JQuery

Senior-level Full Time

US-MA-ANDOVER-AN1 ~ 350 Lowell St ~ … R

1d ago
Senior Machine Learning Engineer GBP 75K-90K

AWS | Azure | Cloud Architecture | Cloud platform | Docker

Coaching | Dental insurance | Enhanced parental leave | Flexible working | Hybrid working

Senior-level Full Time

UK - Remote R

2d ago
Data Engineer GBP 52K-75K

AWS | Apache Flink | Apache Spark | Elasticsearch | Google Cloud

Flexible hybrid schedule | Opportunity for impact | Remote work option | Work with cutting-edge technology

Mid-level Full Time

London R

2d ago
Senior Software Engineer, Embedded UI GBP 75K-90K

AI | API Design | BrightScript | JavaScript | Language Models

Commuter benefits | Dental insurance | Disability insurance | Financial wellness support | Health insurance

Senior-level Full Time

Manchester, United Kingdom R

3d ago
Senior Software Engineer, Training & Experimentation USD 180K-250K

API Development | AWS | Asynchronous processing | Automated testing | Azure

401k matching | Company holidays | Company winter break | Dental coverage | Flexible schedule

Senior-level Full Time

London, England, United Kingdom; New York, … R

3d ago
Data Engineer III GBP 80K-90K

AWS | Automated testing | CI/CD | CockroachDB | DBT

Co-working space access | Company retreat | Equipment stipend | Fully remote | Home office stipend

Senior-level Full Time

United Kingdom R

4d ago
Security Analytics Engineer GBP 72K-80K

CI/CD | DBT | Data Governance | Data Lineage | Data Modeling

25 days holiday per year | Access to cycle garage and showers | Dental scheme | Free soft drinks | Hybrid working

Senior-level Full Time

United Kingdom, London R

4d ago
GenAI Platform Engineer, Senior Associate Director GBP 61K-72K

AWS | Agent Orchestration | Agent systems | Cloud platform | Docker

Contributory pension scheme | Enhanced maternity and adoption pay | Private healthcare

Mid-level Full Time

Sheffield, United Kingdom R

4d ago
AI Inference Tools Engineer USD 167K-242K

Agent Frameworks | Benchmarking | C++ | CUDA | Dashboards

401k matching | Flexible paid time off | Health insurance | Hybrid work options | Local meetups

Senior-level Full Time

United States, United Kingdom R

4d ago
Senior AI Solution Engineer GBP 65K-75K

API Integration | Bias Mitigation | CI/CD | Cloud Computing | Containerization

Benefits package | Career growth | Hybrid working | Mentorship | Ongoing development

Senior-level Full Time

Warminster, Wiltshire, United Kingdom R

4d ago
Senior Machine Learning Engineer (3967) GBP 72K-85K

Anomaly Detection | CI/CD | Classification | Clustering | Computer Vision

Agile environment | Knowledge sharing | Mentorship

Senior-level Full Time

United Kingdom - Remote R

4d ago
Data Engineer GBP 69K-94K

Apache Airflow | Apache Spark | Azure | Batch Processing | Data Lakes

Accessibility accommodations | Critical illness cover | Flexible hybrid work environment | Holiday allowance | Life insurance

Entry-level Full Time

Manchester, United Kingdom R

4d ago
Applied Scientist, Intelligent Talent Acquisition - Lead Generation & Detection Services GBP 80K-122K

A/B | A/B Testing | B testing | C++ | Data Mining

Senior-level Full Time

Edinburgh, Scotland, GBR R

4d ago
Lead AI Software Engineer GBP 70K-90K

Angular | Automated testing | CI/CD | Cloud Native | Code review

Engineering leadership opportunities | Hybrid work | Professional development

Senior-level Full Time

London, GB R

4d ago
Embedded Firmware Engineer GBP 55K-60K

Bare Metal | C# | C++ | CMock | Cryptography

Annual leave | Career development | Inclusive culture | Work-life balance

Mid-level Full Time

Cardiff, Wales, GB, CF15 7AB R

4d ago
Mid/Senior Data Engineer GBP 64K-74K

Apache Airflow | Apache Spark | Azure Data | Azure Data Factory | CI/CD

Cycle to work scheme | Employee assistance programme | Enhanced maternity and paternity pay | Flexible working | Home working

Senior-level Full Time

London, England, United Kingdom R

4d ago
Lead Analytics Partner, EMEA (Sales, Marketing & Alternative Investments) GBP 75K-100K

AWS | Azure | Bayesian Methods | Clustering | Data Governance

Flexible work schedule | In office collaboration 4 days per week | One day per week remote work | Permanent employment

Senior-level Full Time

47053 Threadneedle - London - 35, … R

4d ago