Senior Automation Tester (Python) – Agentic AI & LLM Systems (Hybrid)
Edinburgh, Scotland, United Kingdom
R
GBP 70K-80K (estimate) Senior-level Contract Full Time
Tasks
- Build batch and scheduled test executions
- Collaborate with engineering AI ML and product teams
- Design automated tests for LLM responses
- Develop Python automation framework
- Execute end to end agentic scenarios
- Implement AI testing strategies and evaluation methods
- Integrate automated tests into CI/CD pipelines
- Manage code repositories and branching strategies
- Test conversational flows
- Test retrieval augmented generation pipelines
Perks/Benefits
Skills/Tech-stack
Azure DevOps | CI/CD | Cron | Docker | Git | GitHub Actions | Jenkins | Kubernetes | LLM | Pytest | Python | RAG | Retrieval-Augmented Generation | Source Control | Test Framework | Test automation
Education
N/A
Related jobs
-
Senior Staff Engineer (LLM) GBP 90K-120KAgent systems | Anthropic API | Authentication | Event Driven | Event-driven architectureSenior-level Full TimeRemote, United Kingdom R1d ago
-
Full Stack Engineer / Applied AI GBP 80K-120KAI coding | AI coding assistant | AI workflows | API Design | Agentic AIAI-first engineering culture | Access to Product Leadership | Experimentation freedom | Fully remoteSenior-level Full TimeLondon, United Kingdom R1d ago
-
AWS DMS | Amazon Bedrock | Amazon Kinesis | Amazon QuickSight | Amazon SageMakerCommunity forums | Documentation and transparency culture | Flexible shifts | Mentorship | No weekend workSenior-level Contract Full TimeLondon R1d ago
-
Senior AI Engineer, Edinburgh GBP 75K-105KAPI Integration | Artificial Intelligence | Backend Services | Claude Code | Context windowGym membership | Health insurance | Hybrid work option | Life Event day | Mental health supportSenior-level Full TimeEdinburgh R1d ago
-
Senior Machine Learning Manager, Borrowing GBP 138K-176KAI | AI Platform | AWS | BigQuery | Cloud platformFlexible working hours | Learning budget | Relocation support | Remote work | Visa sponsorshipSenior-level Full TimeCardiff, London or Remote (UK) R2d ago
-
Staff MLOps Engineer (AI/ML Platform) GBP 90K-115KAWS | AWS EKS | Apache Spark | Batch Processing | DatabricksRemote work optionsSenior-level Full TimeRemote, Remote, United Kingdom R2d ago
-
Staff Analytics Engineer GBP 121K-121KBatch Processing | BigQuery | CI/CD | DBT | Data ArchitectureDistributed working options | Flexible working hours | Learning budget | Relocation support | Visa sponsorshipSenior-level Full TimeCardiff, London or Remote (UK) R2d ago
-
Senior Business Intelligence Data Engineer GBP 60K-70KAirbyte | CI/CD | DBT | Data Governance | Data LineageSenior-level Full TimeUK (Home based) R2d ago
-
Machine Learning Systems Engineer, Ads ML Platform GBP 74K-100KApache Airflow | Apache Flink | Apache Spark | Google BigQuery | KafkaBike to work scheme | Family planning support | Flexible vacation | Gender-affirming care | Group Personal Pension SchemeSenior-level Full TimeRemote - United Kingdom R2d ago
-
Data Scientist Consultant - Hybrid GBP 70K-70KApache Spark | Data Analysis | Data Governance | Data Security | Data VisualizationCycle to work scheme | Discounted gym membership | Employee assistance programme | Flexible working options | Hybrid workingEntry-level Full TimeBelfast 10 Mays Meadow, United Kingdom R2d ago
-
Analytics Engineer / Data Engineer GBP 60K-80KCI/CD | DBT | Databricks | Entity Resolution | Fuzzy Matching30 days annual leave | Development training opportunities | Discount card | Flexible working | One volunteering day per yearSenior-level Full TimeRemote, United Kingdom R3d ago
-
GenAI Platform Lead GBP 84K-120KAWS | Agent Orchestration | Agent systems | Azure | Cloud platformContributory pension | Enhanced Adoption Pay | Enhanced maternity pay | Private healthcare | Professional developmentSenior-level Full TimeSheffield, United Kingdom R3d ago
-
Forward Deployed Engineer (EU) GBP 120K-170KAPI Integration | End to End | End-to-End Development | Go | Machine LearningTravel opportunitiesEntry-level Full TimeLondon, UK, Remote, UK, Munich, GER R3d ago
-
MLOps Engineer (LLM/GenAI) GBP 27K-27KAWS | Accelerate | Azure | Batching | CUDAContributory pension scheme | Enhanced maternity and adoption pay | Private healthcare | Tailored professional development opportunities | Work accommodations supportEntry-level Full TimeSheffield, United Kingdom R3d ago
-
CI/CD | CRM | CrewAI | Evaluation | GitContract role | Flexible working schedule | Hybrid work | Outside IR35Senior-level ContractLondon, United Kingdom R3d ago
-
Anaconda | Anomaly Detection | Data Pipelines | Data Quality | Data integrationBike4Work scheme | Flexible benefits | Gym benefits | Hybrid working | Life assuranceMid-level Full TimeLondon, 21 Moorfields, United Kingdom R3d ago
-
Senior Analytics Engineer GBP 80K-95KAWS | Airflow | BI tools | CI/CD | DBTGlobal team environment | Hybrid work | Learning opportunities | Medical insuranceSenior-level Full TimeSpain, England#SP-UK, Greater London, United Kingdom … R3d ago
-
Analytics Implementation Engineer GBP 50K-60KA/B | A/B Testing | Amplitude | Amplitude Experiment | Assignment LogicAdditional leave | Calm app membership | Cycle to work scheme | Electric car scheme | Enhanced parental leaveMid-level Full TimeLondon, England, United Kingdom R3d ago
-
Software / Machine Learning Engineer GBP 40K-50KAWS | Computer Vision | Deep learning | Generative AI | Hugging FaceFlexible work hours | Gym discounts | Learning resources | Mental health support | MentorshipMid-level Full TimeLondon R4d ago
-
AI Engineer GBP 100K-150KAWS | Agent Frameworks | Amazon Bedrock | Anthropic Claude | AzureEquity | Learning and development stipend | WFH equipment allowance | Wellbeing benefitMid-level Full TimeCopenhagen, DK; London, UK; Remote Europe R4d ago
-
AI Research Engineer GBP 100K-180KC# | CUDA | Deep learning | Machine Learning | PyTorchHybrid Remote | Remote work flexibilityMid-level Full TimeHybrid (UK) R4d ago
-
MLOps Engineer GBP 76K-100KAirflow | Automated retraining | Autoscaling | BigQuery | Blue-Green DeploymentDiscounts | Enhanced parental leave | Holiday allowance | Learning and development programme | Life insuranceSenior-level Full TimeUnited Kingdom - Remote R4d ago
-
Machine Learning Engineer GBP 110K-145KCI/CD | Docker | Feature Engineering | Kubernetes | Model Deployment401k matching | Dental insurance | Flexible paid time off | Health and wellness stipend | Health insuranceSenior-level Full TimeUnited Kingdom R6d ago
-
Airflow | BigQuery | Computer Vision | Deep learning | EmbeddingsBike to work scheme | Family planning support | Flexible vacation | Gender-affirming care | Income replacement programsSenior-level Full TimeRemote - United Kingdom R6d ago
-
Staff Machine Learning Engineer, ML Efficiency GBP 81K-118KApache Spark | C++ | Caching | Cloud Cost Optimization | Cloud infrastructureBike to work scheme | Family planning support | Flexible vacation | Gender-affirming care | Group pension with employer matchSenior-level Full TimeRemote - United Kingdom R7d ago