Senior Automation Tester (Python) – Agentic AI & LLM Systems (Hybrid)
Birmingham, England, United Kingdom
R
GBP 70K-80K (estimate) Senior-level Contract Full Time
Tasks
- Apply AI testing strategies and evaluation methods
- Collaborate with engineering AI ML and product teams to ensure quality
- Design automated tests for LLM responses
- Develop Python automation framework
- Execute end to end agentic scenarios
- Implement batch and scheduled test executions
- Integrate automated tests into CI/CD pipelines
- Manage source code with Git
- Test conversational flows
- Test retrieval augmented generation pipelines
- Validate AI agents and agentic workflows
Perks/Benefits
Skills/Tech-stack
Artificial Intelligence | Azure Repos | CI/CD | Docker | Git | GitHub Actions | Jenkins | Kubernetes | Language Models | Large Language Models | Pytest | Python | RAG | Retrieval-Augmented Generation | Test Framework | Test automation
Education
N/A
Related jobs
-
AI systems | Agent systems | Agentic Workflows | Autonomous AI | Autonomous AI systemsSenior-level Full TimeUnited Kingdom, REMOTE, United Kingdom R20h ago
-
Senior Machine Learning Engineer GBP 80K-109KA/B | A/B Testing | B testing | Clustering | Deployment AutomationDental insurance | Discounts and rewards | Flexible working | Four day working week | Gym membershipSenior-level Full TimeLondon, England, United Kingdom R22h ago
-
Lead Analytics Engineer GBP 97K-125KBigQuery | Data Governance | Data Modeling | Data Testing | Data WarehousingFlexible working hours | Learning budget | Relocation support | Visa sponsorshipSenior-level Full TimeCardiff, London or Remote (UK) R1d ago
-
Staff AI Engineer - AI Transformation GBP 90K-100KAPI Integration | Agent Orchestration | Agent systems | Backend Development | CachingSenior-level Full TimeLondon R1d ago
-
Senior Analytics Engineer GBP 76K-95KAgile | Airflow | BigQuery | Business Intelligence | DBTDistributed Working Within UK | Flexible working hours | Learning budget | Relocation support | Visa sponsorshipSenior-level Full TimeCardiff, London or Remote (UK) R1d ago
-
Senior AI Engineer - AI Transformation GBP 90K-105KAPI Integration | Batching | Caching | Chunking | Conversation memoryLife Event day | Paid time off | Private medical insurance | Volunteer days | Wellbeing daysSenior-level Full TimeLondon R1d ago
-
Data Engineer GBP 60K-74KAutomated testing | DBT | Data Vault | Dataform | Dimensional ModelingAdditional holiday | Dental insurance allowance | Flexible working | Gym membership allowance | Inclusion groupsSenior-level Full TimeLondon, England, United Kingdom R1d ago
-
Senior Software Engineer - Machine Learning (Marketplace Dynamics) (Remote - United Kingdom) GBP 65K-84KCausal Inference | Data Analysis | Decision Trees | Embeddings | Ensemble learningCaregiver reimbursement | Dental insurance | Flexible working hours | Hackathons | Learning groupsSenior-level Full TimeLondon, UK R2d ago
-
Data Engineer GBP 60K-74KAutomated testing | DBT | Data Vault | Data Warehousing | DataformBackground checks | Discounts and rewards | Flexible benefits | Flexible working | Learning and development budgetSenior-level Full TimeLondon, England, United Kingdom R3d ago
-
Data Engineering Consultant GBP 45K-50KAWS Redshift | CI/CD | DBT | Data Modeling | Data WarehousingCareer growth support | Certification opportunities | Coaching mentoring buddy scheme | Hybrid work | Networking eventsMid-level Full TimeLondon, Greater London, United Kingdom (Hybrid) R3d ago
-
Senior-level Full TimeVirtual UK, United Kingdom R3d ago
-
Data Engineer GBP 60K-74KAutomated testing | DBT | Data Vault | Data Warehouse | DataformDental insurance allowance | Flexible working | Gym membership allowance | Holiday 25 days plus Bank Holidays | Learning and development budgetSenior-level Full TimeLondon, England, United Kingdom R3d ago
-
A/B | A/B Testing | API Management | AWS Bedrock | ApigeeSenior-level Full TimeLondon, United Kingdom R4d ago
-
Senior Analytics Engineer GBP 70K-74KAWS Glue | AWS Lambda | AWS Step Functions | Automated testing | CI/CD25 days annual leave | Cycle to work scheme | Electric car scheme | Enhanced parental leave | Fertility treatment financial supportSenior-level Full TimeLondon, England, United Kingdom R4d ago
-
Markets Data Engineer GBP 53K-76KDashboards | Data Modeling | Data Visualization | Financial markets | PandasAnnual leave | Bank holidays | Employee assistance | Flexible benefits scheme | Hybrid workingEntry-level Full TimeLondon, United Kingdom R4d ago
-
Markets Data Scientist GBP 60K-86KAmazon Redshift | Data Visualization | ETL | Feature Engineering | Interactive dashboardsEmployee assistance program | Flexible benefits | Hybrid work model | Income protection | Life assuranceMid-level Full TimeLondon, United Kingdom R4d ago
-
Senior AI Agent Evaluation Engineer USD 100K-100KDocker | FastAPI | Functional testing | Integration Testing | JavaScriptFlexible scheduling | Project based workSenior-level Full TimeUnited Kingdom - Remote R4d ago
-
Software Engineer - Analytics Hub GBP 91K-110KAWS | Agile | Artificial Intelligence | Node.js | ReactHybrid work model | Mentorship culture | Remote work flexibilitySenior-level Full TimeLondon, United Kingdom R6d ago
-
Junior Data Engineer GBP 30K-40KApache Airflow | Apache Spark | Data Governance | Data Modeling | Data ProcessingGrowth plan | Gym discounts | Learning resources | Mental health support | MentorshipEntry-level Full TimeLondon R7d ago
-
DataOps Engineer GBP 50K-60KAWS | Ansible | Bash | Docker | ELTFlexible working hours | Remote work option | Team collaborationMid-level Full TimeUnited Kingdom R7d ago
-
Senior AI Engineer, AI Lab GBP 90K-131KBLEU | Bark | DVC | ElevenLabs | Fine TuningAnnual leave | Employee assistance program | Free Economist content online subscription | Moving home allowance | Parental leaveSenior-level Full TimeLondon - Commercial R7d ago
-
AI/ML - Platform Engineering, Vice President GBP 200K-280KAPI Design | Agile | Cloud Computing | Distributed Systems | Fine TuningEducation reimbursement | Family support programs | Flexible time off | Health and wellness benefits | Hybrid work modelExecutive-level Full TimeED3 - 20 Brandon Street, Edinburgh, … R7d ago
-
Data Engineer GBP 80K-80KAWS ECS | Amazon S3 | Apache Iceberg | DBT | DagsterFlexible working | Home office setup | Income protection | Nursery salary sacrifice scheme | Private health insuranceSenior-level Full TimeUnited Kingdom - Remote R7d ago
-
Apache Spark | Automated testing | BI Dashboards | CI/CD | Data GovernancePermanent contract | Remote workSenior-level Full TimeWork From Home - UK, United … R7d ago
-
Machine Learning Manager, Borrowing GBP 100K-160KAI Platform | AWS | BigQuery | Cloud platform | Credit RiskEquipment provided | Flexible working hours | Learning budget | Relocation support | Visa sponsorshipMid-level Full TimeCardiff, London or Remote (UK) R8d ago