Senior Automation Tester (Python) – Agentic AI & LLM Systems (Hybrid)
Glasgow, Scotland, United Kingdom
R
GBP 70K-80K (estimate) Senior-level Contract Full Time
Tasks
- Apply AI evaluation methods
- Automate batch and scheduled test runs
- Collaborate with engineering AI ML product teams
- Design automated tests for LLM responses
- Develop Python automation framework
- Execute end to end agentic scenarios
- Integrate tests into CI/CD pipelines
- Manage source code with Git
- Test conversational flows
- Test retrieval augmented generation pipelines
Perks/Benefits
Skills/Tech-stack
Agentic AI | Azure Repos | CI/CD | Cron | DeepEval | Docker | Git | GitHub Actions | Jenkins | Kubernetes | LLM | Pytest | Python | RAG | Ragas | Retrieval-Augmented Generation
Education
N/A
Related jobs
-
Applied AI Software Engineer GBP 75K-90KAgile | Azure | Continuous Delivery | Data Observability | Data PrivacyAnnual leave | Critical illness protection | Cycle to work | Dental coverage | Electric vehicle schemeSenior-level Full TimeGlasgow, Lanarkshire, United Kingdom R9h ago
-
C# | MATLAB | NumPy | Pandas | PythonFlexible schedule | Project based workSenior-level FreelanceUnited Kingdom - Remote R16h ago
-
Data Engineer (Cloud) GBP 52K-52KApache Airflow | Apache Spark | Azure | CI/CD | Data GovernanceHybrid workingMid-level Full TimeGB-ENG-LAN-Preston R1d ago
-
AI Engineer GBP 52K-54KAI Search | Azure AI | Azure AI Search | CI/CD | DatabricksHybrid work arrangementsSenior-level Full TimeGB-ENG-LAN-Preston R1d ago
-
AI Testing | Agentic AI | Azure Repos | CI/CD | Conversational AIHybrid workSenior-level Contract Full TimeGlasgow, Scotland, United Kingdom R1d ago
-
Data Engineer GCP (Remote) GBP 70K-86KAlerting | CI/CD | Cloud Composer | Cloud Functions | Cloud StorageRemote workEntry-level Full TimeStoke-on-Trent, England, United Kingdom R1d ago
-
AI Data Engineering Lead GBP 72K-80KAWS Glue | AWS IAM | AWS Lambda | AWS S3 | Amazon AthenaRemote work flexible arrangements | Work-life balanceSenior-level Full TimeNottinghamshire, UK R1d ago
-
AI Model Lead GBP 72K-90KDataset versioning | Deep learning | Evaluation | Experiment tracking | Fine TuningRemote work | Work-life balanceSenior-level Full TimeNottinghamshire, UK R1d ago
-
AI Model Lead GBP 72K-90KDataset versioning | Distributed Training | Experiment tracking | Fine Tuning | Language ProcessingRemote workSenior-level Full TimeNottinghamshire, UK R1d ago
-
AI Engineer, LLM Systems & Agentic Workflows GBP 97K-130KAgentic Workflows | Anthropic API | Constrained decoding | Evaluation Pipelines | Go100 percent remote | Employee referral bonuses | Flexible time off | Fun events | Room to growSenior-level Full TimeArgentina; Brazil; Chile; Colombia; Costa Rica; … R1d ago
-
Applied AI Analytics Lead 14 Months FTC GBP 70K-84KAzure Foundry | Copilot Studio | DBT | Data Quality | Microsoft FabricHybrid work modelSenior-level ContractLondon, England, United Kingdom R2d ago
-
API Development | Airflow | Alerting | Amazon Athena | Backend ServicesCommunity events | Conference travel | Equity | Fully remote | Generous PTOSenior-level Full TimeLondon, United Kingdom R2d ago
-
Data Engineer - Claims Analytics GBP 33K-33KAzure Blob | Azure Blob Storage | Azure Data | Azure Data Factory | Azure Key VaultAnnual leave increase | Bonus scheme | Cashback | Cycle to work | DiscountsMid-level Full TimeLondon / Hybrid - 37, United … R2d ago
-
AI Developer - Dutch Speaking GBP 40K-50KAWS | Authentication | Automated testing | Azure | CI/CDRemote workEntry-level Full TimeUnited Kingdom - Remote R2d ago
-
Staff AI Engineer GBP 70K-90KAWS | Airflow | Batch Processing | Data Pipelines | DockerAnnual wellbeing allowance | Employee stock option program | Paid time off | Parental leave | Retirement contributionsSenior-level Full TimeLondon R2d ago
-
Mid-level Full TimeLeeds/Sheffield/Manchester, UK (Hybrid) R2d ago
-
APIs | Azure | CI/CD | Data Governance | Distributed SystemsBi weekly engineering gatherings | Carbon footprint offset via Ecologi | Company laptop and tools | Company social events | Enhanced family policySenior-level Full TimeMoorgate, SouthEast EC2, United Kingdom R3d ago
-
Freelance Machine Learning Engineer USD 110KLLMs | Langchain | MLOps | Machine Learning | NumPyFlexible hours | Part-time engagement | Project based workMid-level FreelanceUnited Kingdom - Remote R3d ago
-
Langchain | Language Models | Large Language Models | MLOps | NumPyEnglish CV required | Freelance project-based work | Part-time scheduleMid-level FreelanceUnited Kingdom - Remote R3d ago
-
Data Analysis | Data Ingestion | Data cleaning | Exploratory Data Analysis | Feature EngineeringFlexible hours | Freelance project-based work | Part-time engagementMid-level FreelanceUnited Kingdom - Remote R5d ago
-
Staff Engineer — Data Platform GBP 80K-110KAWS | Apache Airflow | Apache Flink | Apache Kafka | DBTFlexible days off | Health plan | Home office bonus | Language courses | Personal growth coursesSenior-level Full TimeLondon R5d ago
-
Lead Data Engineer (eDV) GBP 64K-70KAgile | Amazon Web Services | Ansible | Athena | Data Modeling25 days holiday plus bank holidays | Annual training allowance | Company paid medical insurance | Employee assistance plan | Enhanced DV Security ClearanceSenior-level Full TimeHybrid, UK R6d ago
-
Data Platform Engineer - Fixed Term Contract GBP 70K-90KBatch Processing | CI/CD | Cloud Native | Cloud-native infrastructure | Data ContractsSenior-level Contract TemporaryGermany (Remote) ; Ireland (Remote); Netherlands … R6d ago
-
Senior Analytics Engineer GBP 75K-80KAutomated testing | Bronze Silver Gold | CI/CD | DBT | Data ModelingFlexible working | Life assurance | Mental health support | Pension plan | Private dental insuranceSenior-level Full TimeUnited Kingdom - Remote R6d ago
-
Alerting | Cloud Platforms | Docker | Fault Tolerance | High AvailabilityBonus programs | Flexible schedule | Remote workMid-level FreelanceUnited Kingdom - Remote R6d ago