Senior Automation Tester (Python) – Agentic AI & LLM Systems (Hybrid)
Birmingham, England, United Kingdom
R
GBP 70K-80K (estimate) Senior-level Contract Full Time
Tasks
- Apply AI testing strategies and evaluation methods
- Collaborate with engineering AI ML and product teams to ensure quality
- Design automated tests for LLM responses
- Develop Python automation framework
- Execute end to end agentic scenarios
- Implement batch and scheduled test executions
- Integrate automated tests into CI/CD pipelines
- Manage source code with Git
- Test conversational flows
- Test retrieval augmented generation pipelines
- Validate AI agents and agentic workflows
Perks/Benefits
Skills/Tech-stack
Artificial Intelligence | Azure Repos | CI/CD | Docker | Git | GitHub Actions | Jenkins | Kubernetes | Language Models | Large Language Models | Pytest | Python | RAG | Retrieval-Augmented Generation | Test Framework | Test automation
Education
N/A
Related jobs
-
Sr AI Engineer | Remote - Europe | TS/Vue/NodeJS GBP 80K-120KAPI Design | Agent architecture | Anthropic | Chat completion | Chunking401k match | Course budget | Dental coverage | Equity | HackathonsSenior-level Full TimeBerlin Office R1d ago
-
Data Analyst - Energy GBP 26K-26KBigQuery | CI/CD | Data Documentation | Data Modeling | Data PipelinesCompany events | Flexible working | Gym membership | Inclusion groups | Learning and development budgetMid-level Full TimeLondon, England, United Kingdom R1d ago
-
Senior Machine Learning Engineer GBP 78K-109KA/B | A/B Testing | B testing | Clustering | DockerDental insurance allowance | Flexible working | Four day working week | Gym membership allowance | HolidaySenior-level Full TimeLondon, England, United Kingdom R2d ago
-
Data Analyst GBP 26K-26KBigQuery | CI/CD | Dashboarding | Data Documentation | Data ModelingFlexible benefits | Flexible working | Learning and development budget | Life assurance | Matched contribution pension schemeMid-level Full TimeLondon, England, United Kingdom R2d ago
-
Data Engineer GBP 60K-75KDBT | Data Vault | Dataform | Dimensional Modeling | DockerFlexible working arrangements | Learning and development budget | Optional four day working week | Paid sabbatical | Remote-first workSenior-level Full TimeLondon, England, United Kingdom R2d ago
-
Senior Analytics Engineer GBP 62K-73KBudgeting | Data Governance | Data Modeling | Data Pipelines | DatabricksFlexible hybrid working | Home office setup budget | Monthly Healthcare Allowance | Parental leave | Relocation options after 1 yearSenior-level Full TimeCzechia; Spain; United Kingdom R2d ago
-
AI Solutions Engineer GBP 60K-80KBusiness case | Business case development | Case Development | Conversational AI | Data StorytellingCycle to work | Life insurance | LinkedIn Learning | Paid holiday | Pension schemeMid-level Full TimeLondon R2d ago
-
Data Analyst - Energy GBP 26K-26KBigQuery | CI/CD | Data Modeling | Data Observability | Data PipelinesDental insurance | Flexible working | Gym membership | Holiday days increase with tenure | Inclusion & Belonging groupsMid-level Full TimeLondon, England, United Kingdom R2d ago
-
Senior Machine Learning Engineer GBP 78K-109KA/B | A/B Testing | B testing | Docker | FeastDental insurance allowance | Flexible working | Gym membership allowance | Learning and development budget | Life assuranceSenior-level Full TimeLondon, England, United Kingdom R2d ago
-
Technology - ML Ops Engineer GBP 60K-75KAKS | Access Control | Alerting | Auditability | AzureAnnual leave | Buy and sell holiday | CPD support | Core hours flexible schedule | Cycle to work schemeMid-level Full TimeLeeds, England, United Kingdom R3d ago
-
Tech Lead, LLM & Generative AI (Full Remote - UK) GBP 90K-140KDPO | Data labeling | Evaluation Frameworks | Fine Tuning | HuggingfaceAI tools access | Annual in-person meetup | Co-working space budget | Equipment allowance | Fully remoteSenior-level Full TimeUnited Kingdom R4d ago
-
Automation | C++ | Collateral Management | Econometrics | Funding risk30 days holiday | Coaching | Flexible working | Hybrid working | Life assuranceMid-level Full TimeLondon, 21 Moorfields, United Kingdom R4d ago
-
Data Engineer GBP 45K-45K3NF | Apache Airflow | Azure Data | Azure Data Factory | CI/CDCompany pension | Cycle purchase scheme | Discount schemes | Flexible holiday program | Flexible workingMid-level Full TimeGBR-Llandudno TYC, United Kingdom R4d ago
-
Senior Data Engineer, Anti-Fraud Technology GBP 90K-106KAWS | Apache Flink | Apache Kafka | Apache Kafka Streams | CloudFormationHybrid workSenior-level Full TimeLondon, GBR, United Kingdom R4d ago
-
Bilby | CAMB | Class | DOLFINx | FenicsPart-time project workSenior-level FreelanceUnited Kingdom - Remote R4d ago
-
Combinatorics | Graph theory | MATLAB | NumPy | Number theoryPart-time flexible hours | Project based workSenior-level FreelanceUnited Kingdom - Remote R4d ago
-
Senior ML Engineer - Kimchi (LLM Inference Optimization GBP 110K-141KActivations quantization | Amazon Web Services | ArgoCD | CUDA | CUDA-adjacent toolingEquipment budget | Equity options | Extra days off | Hackathon | Learning budgetSenior-level Full TimeUnited Kingdom R5d ago
-
Freelance Machine Learning Engineer USD 110KLangchain | MLOps | NumPy | Pandas | Prompt engineeringPart-time opportunities | Project based workMid-level FreelanceUnited Kingdom - Remote R6d ago
-
Langchain | MLOps | NumPy | Pandas | Prompt engineeringFlexible part-time hours | Freelance project-based work | Paid per projectMid-level FreelanceUnited Kingdom - Remote R6d ago
-
GenAI Prototyping Specialist GBP 115K-165KAPI Integration | AWS Bedrock | Agentic Workflows | Anthropic Claude | AutogenClient office collaboration sessions | Flexible remote days | Hybrid workMid-level Full TimeLondon, United Kingdom R8d ago
-
Bash | Coverage.py | Dagger | Docker | GcovFlexible hours | Fully remote | Opportunity to work on innovative AI projects | Project-based collaboration | Supportive global communitySenior-level Full TimeUnited Kingdom - Remote R8d ago
-
LLM | Langchain | MLOps | Matplotlib | NumPyPart-time opportunities | Project based workMid-level FreelanceUnited Kingdom - Remote R8d ago
-
Data Ingestion | Data Transformation | Data Validation | Django | EmbeddingsFully remoteMid-level Full TimeMarlow, United Kingdom R8d ago
-
Software Development Engineer II, Data Platform USD 160K-217KAWS Lambda | Amazon ECS | Amazon EMR | Amazon Kinesis | Apache AirflowFlexible work schedule | Health care | Parental leave | Remote workMid-level Full TimeMapbox UK R8d ago
-
Senior Software Engineer, Embedded UI - C++ GBP 66K-97KAI | BrightScript | C++ | Cause analysis | FRAME EngineFlexible remote work | Hybrid work schedule | MentorshipSenior-level Full TimeManchester, United Kingdom R9d ago