Senior Automation Tester (Python) – Agentic AI & LLM Systems (Hybrid)
Leeds, England, United Kingdom
R
GBP 70K-80K (estimate) Senior-level Contract Full Time
Tasks
- Apply AI testing and evaluation methods
- Build batch and scheduled execution workflows
- Collaborate with engineering AI ML and product teams
- Design automated tests for LLM responses
- Develop automation framework for AI agents
- Execute automated tests for conversational flows
- Implement automated tests for retrieval augmented generation
- Integrate automated tests into CI/CD pipelines
- Manage code repositories with GIT
- Run end to end agentic scenarios tests
Perks/Benefits
Skills/Tech-stack
Agentic AI | Azure DevOps | CI/CD | Conversational AI | Cron | Deep learning | Docker | Git | GitHub Actions | Jenkins | Kubernetes | LLM | Pytest | Python | RAG | Retrieval-Augmented Generation
Education
N/A
Related jobs
-
Applied AI Engineer GBP 85K-110KA/B | A/B Testing | Anthropic | B testing | ExperimentationFully remote | Global engineering collaboration | High ownership culture | Learning and development budgetMid-level Full TimeUnited Kingdom R1d ago
-
Lead AI Engineer (AI Systems & Automation) GBP 78K-109KAlerting | Anthropic | Distributed Systems | Docker | EmbeddingsFully remote | Global engineering collaboration | High ownership culture | Learning and development budgetSenior-level Full TimeUnited Kingdom R1d ago
-
Consulting Systems Engineer, Data Management (EMEA) GBP 75K-101KAWS | Ansible | Apache Kafka | Azure | Cloud hybridCompany-sponsored team events | Flexible time off | Wellness resourcesSenior-level Full TimeRemote, United Kingdom R2d ago
-
Senior AI/ML engineer GBP 120K-150KAWS | CI/CD | Databricks | Deep learning | Delta LakeAccelerated professional growth | Enhanced parental leave | Female health leave | Fully paid sabbatical | Health pension wellbeing benefitsSenior-level Full TimeLondon R2d ago
-
Analytics Engineer GBP 75K-90KAmazon Redshift | Apache Airflow | CI/CD | DBT | Data ModellingEnglish language at office | In person 3 days per week | Relocation supportMid-level Full TimeLondon R3d ago
-
Principal Data Engineer GBP 90K-103KCI | CI/CD | DBT | Data Contracts | Data ManagementCareer Development Programs | Collaborative culture | Flexible time off | Flexible work schedules | Health and wellness benefitsSenior-level Full TimeAntrim, Northern Ireland, United Kingdom; Remote- … R3d ago
-
Senior-level Full TimeLondon, England, United Kingdom - Remote R3d ago
-
Senior Staff Engineer (LLM) GBP 90K-120KAgent systems | Anthropic API | Authentication | Event Driven | Event-driven architectureSenior-level Full TimeRemote, United Kingdom R4d ago
-
Full Stack Engineer / Applied AI GBP 80K-120KAI coding | AI coding assistant | AI workflows | API Design | Agentic AIAI-first engineering culture | Access to Product Leadership | Experimentation freedom | Fully remoteSenior-level Full TimeLondon, United Kingdom R4d ago
-
AWS DMS | Amazon Bedrock | Amazon Kinesis | Amazon QuickSight | Amazon SageMakerCommunity forums | Documentation and transparency culture | Flexible shifts | Mentorship | No weekend workSenior-level Contract Full TimeLondon R4d ago
-
Senior AI Engineer, Edinburgh GBP 75K-105KAPI Integration | Artificial Intelligence | Backend Services | Claude Code | Context windowGym membership | Health insurance | Hybrid work option | Life Event day | Mental health supportSenior-level Full TimeEdinburgh R4d ago
-
Sr Data Science Engineer GBP 81K-115KARIMA | Databricks | Decision Trees | K-Means | K-means ClusteringSenior-level Full TimeLondon, United Kingdom R4d ago
-
Senior Machine Learning Manager, Borrowing GBP 138K-176KAI | AI Platform | AWS | BigQuery | Cloud platformFlexible working hours | Learning budget | Relocation support | Remote work | Visa sponsorshipSenior-level Full TimeCardiff, London or Remote (UK) R4d ago
-
Staff MLOps Engineer (AI/ML Platform) GBP 90K-115KAWS | AWS EKS | Apache Spark | Batch Processing | DatabricksRemote work optionsSenior-level Full TimeRemote, Remote, United Kingdom R5d ago
-
Staff Analytics Engineer GBP 121K-121KBatch Processing | BigQuery | CI/CD | DBT | Data ArchitectureDistributed working options | Flexible working hours | Learning budget | Relocation support | Visa sponsorshipSenior-level Full TimeCardiff, London or Remote (UK) R5d ago
-
Senior Business Intelligence Data Engineer GBP 60K-70KAirbyte | CI/CD | DBT | Data Governance | Data LineageSenior-level Full TimeUK (Home based) R5d ago
-
Machine Learning Systems Engineer, Ads ML Platform GBP 74K-100KApache Airflow | Apache Flink | Apache Spark | Google BigQuery | KafkaBike to work scheme | Family planning support | Flexible vacation | Gender-affirming care | Group Personal Pension SchemeSenior-level Full TimeRemote - United Kingdom R5d ago
-
Data Scientist Consultant - Hybrid GBP 70K-70KApache Spark | Data Analysis | Data Governance | Data Security | Data VisualizationCycle to work scheme | Discounted gym membership | Employee assistance programme | Flexible working options | Hybrid workingEntry-level Full TimeBelfast 10 Mays Meadow, United Kingdom R5d ago
-
Analytics Engineer / Data Engineer GBP 60K-80KCI/CD | DBT | Databricks | Entity Resolution | Fuzzy Matching30 days annual leave | Company pension scheme | Development and training opportunities | Discounts via Blue Light Card | Flexible workingSenior-level Full TimeRemote, United Kingdom R5d ago
-
GenAI Platform Lead GBP 84K-120KAWS | Agent Orchestration | Agent systems | Azure | Cloud platformContributory pension | Enhanced Adoption Pay | Enhanced maternity pay | Private healthcare | Professional developmentSenior-level Full TimeSheffield, United Kingdom R5d ago
-
Forward Deployed Engineer (EU) GBP 120K-170KAPI Integration | End to End | End-to-End Development | Go | Machine LearningTravel opportunitiesEntry-level Full TimeLondon, UK, Remote, UK, Munich, GER R5d ago
-
MLOps Engineer (LLM/GenAI) GBP 27K-27KAWS | Accelerate | Azure | Batching | CUDAContributory pension scheme | Enhanced maternity and adoption pay | Private healthcare | Tailored professional development opportunities | Work accommodations supportEntry-level Full TimeSheffield, United Kingdom R5d ago
-
CI/CD | CRM | CrewAI | Evaluation | GitContract role | Flexible working schedule | Hybrid work | Outside IR35Senior-level ContractLondon, United Kingdom R6d ago
-
Anaconda | Anomaly Detection | Data Pipelines | Data Quality | Data integrationBike4Work scheme | Flexible benefits | Gym benefits | Hybrid working | Life assuranceMid-level Full TimeLondon, 21 Moorfields, United Kingdom R6d ago
-
Analytics Implementation Engineer GBP 50K-60KA/B | A/B Testing | Amplitude | Amplitude Experiment | Assignment LogicAdditional leave | Calm app membership | Cycle to work scheme | Electric car scheme | Enhanced parental leaveMid-level Full TimeLondon, England, United Kingdom R6d ago