AI Evaluation & Assurance Architect
Knutsford, Radbroke Hall, United Kingdom
GBP 75K-95K (estimate) Senior-level Full Time
Tasks
- Conduct hallucination testing
- Configure CI CD gating
- Create governance assurance evidence
- Define scoring methods and test datasets
- Design AI evaluation architecture
- Ensure auditability of AI systems
- Establish release gates for AI systems
- Implement continuous monitoring
- Lead innovation for AI evaluation processes
- Operationalize LLM evaluation
- Perform bias testing
- Prevent data leakage
- Run adversarial testing
- Set up observability for AI systems
- Support model risk framework validation
- Translate AI risks into controls
Perks/Benefits
Skills/Tech-stack
Adversarial Testing | Artificial Intelligence | Auditability | Bias Testing | CI/CD | Confidence metrics | Continuous Monitoring | Data Leakage Prevention | Data leakage | Evaluation Architecture | Generative AI | Hallucination Testing | LLMOps | Leakage prevention | Machine Learning | Model Risk Management | Model risk | Observability | Probabilistic Modeling | Release gates | Risk Management | Risk controls | Sampling | Scoring | Simulation | Statistics | Synthetic data | Test Dataset
Education
N/A
Roles
AI | AI Architect | Architect | Engineer | Learning Engineer | Machine Learning Engineer
Related jobs
-
AI Solution Architect GBP 75K-100KAI Services | API Development | API Gateway | AWS | AWS BedrockBusiness travel | Free eye tests | Glasses Support | Hybrid work schedule | Incentivized certifications and accreditationsSenior-level Full TimeLondon, Birmingham, Manchester, Newcastle upon Tyne, … R12h ago
-
Internal Audit AVP - Data Analytics GBP 47K-58KAWS | Alteryx | Audit Testing | Cloud Computing | DashboardsEntry-level Full TimeCanary Wharf, 1 Churchill Place, United …1d ago
-
AI/ML/Data Science Engineer GBP 50K-60KAnomaly Detection | Cloud Platforms | Computer Vision | Computer Vision Video Analytics | Data PreprocessingAnnual leave | Bank Holiday Leave | Dental care | Discounts | Enhanced maternity/paternity leaveMid-level Full TimeBiggin Hill, United Kingdom1d ago
-
Senior GenAI Software Engineer GBP 76K-100KA/B | A/B Testing | B testing | Debugging | Diffusion ModelsDental insurance | Equity | Health insurance | Vision insurance | Wellness stipendsSenior-level Full TimeLondon, UK R1d ago
-
Data Science Lead - Logistics GBP 62K-80KArtificial Intelligence | Big Data | Cloud | IoT | JavaAnnual leave | Buy As You Earn Scheme | Cycle to work scheme | Employee assistance programme | Employee discountsSenior-level Full TimeLondon, United Kingdom R1d ago
-
Senior Data Engineer BI Hub GBP 62K-77KAWS | Agile | Alerting | Azure | CI/CDAnnual holiday allowance | Buy additional holiday | Colleague discount | Cycle to work scheme | DiscountsSenior-level Full TimeLondon, London, United Kingdom1d ago
-
Applied AI ML Lead - LLM Suite Engineering GBP 72K-95KAPIs | AWS | AWS Bedrock | Agent communication | Agent to AgentSenior-level Full TimeLONDON, LONDON, United Kingdom1d ago
-
Senior AI Engineer GBP 75K-75KAWS | Agent systems | Artificial Intelligence | Azure | CI/CDAnnual bonus | Discounted gym membership | Electric vehicle leasing | Experience days | Hybrid workSenior-level Full TimeLondon, United Kingdom R1d ago
-
Full Stack AI Engineer GBP 78K-80KAlembic | Application Insights | Asynchronous programming | Auditability | AuthenticationMid-level Full TimeBelfast1d ago
-
Principal Computer Vision Engineer GBP 67K-109K3D Object Tracking | ARM | C# | C++ | Camera ModelsHybrid work | Mentoring | Professional developmentSenior-level Full TimeLondon, UK1d ago
-
AI Engineer / Machine Learning Engineer GBP 85K-100KAlgorithms | Cloud Computing | Data Science | Data Structures | DockerSenior-level Full TimeLondon, England, United Kingdom1d ago
-
Data Science Lead - Fulfilment GBP 70K-90KArtificial Intelligence | Big Data | Cloud Computing | Data Science | Deep learningAnnual leave | Cycle to work scheme | Employee assistance programme | Employee discounts | Free deliverySenior-level Full TimeKrakow, Poland; London, United Kingdom R1d ago
-
Data Engineer (GCP) GBP 70K-80KCI/CD | Cloud Composer | Cloud Functions | Cloud Storage | Cloud platformMid-level Full TimeManchester, England, United Kingdom1d ago
-
Data Engineer GCP (Remote) GBP 70K-80KAlerting | CI/CD | Cloud Composer | Cloud Functions | Cloud StorageRemote workMid-level Full TimeStoke-on-Trent, England, United Kingdom R1d ago
-
Entry-level Full TimeStoke-on-Trent, England, United Kingdom1d ago
-
Agile | Architecture governance | Composable Architecture | Cost of ownership | Data centric architectureColleague discount | Competitive holiday allowance | Exclusive perks and savings portal | Family policies | Paid volunteer daySenior-level Full TimeUnited Kingdom1d ago
-
Senior Data Engineer GBP 72K-80KAzure Data | Azure Data Factory | CI/CD | Change Data Capture | DAXAgile team collaboration | Coaching and mentoring | International environment | Workshops and design sessionsSenior-level Full TimeLondon, United Kingdom1d ago
-
Agent-based | Agent-based systems | Generative AI | Language Models | Large Language ModelsIn-office FlexibilityMid-level Full TimeLondon, United Kingdom2d ago
-
Senior Data Science Engineer GBP 72K-80KAutomated trading | Data Analysis | Data Visualization | Databricks | ExperimentationGaming license assistanceSenior-level Full TimeLondon, UK, United Kingdom2d ago
-
Machine Learning Engineer GBP 70K-85KAWS Bedrock | Agentic AI | Anomaly Detection | CrewAI | Data ExplorationMid-level Full TimeGlasgow Campus, United Kingdom2d ago
-
Senior-level Full TimeCanary Wharf, 1 Churchill Place, United …2d ago
-
Data Science Engineer GBP 72K-82KA/B | A/B Testing | Apache Airflow | B testing | BigQueryFlexible benefits | Hybrid work model | Life assurance | Paid time off | Private healthcareSenior-level Full TimeLondon 10 Upper Bank Street, United … R2d ago
-
Group AI Leader (Vanguard Program) GBP 72K-100KAI adoption | Artificial Intelligence | Business Unit | Business Unit Coordination | Decision MakingEquity and inclusion support | Lifestyle reward | Personal daysSenior-level Full TimeRemote - UK, United Kingdom R2d ago
-
C++ | Container Orchestration | Data Science | Design Patterns | DockerEmployee assistance program | Hybrid work model | Learning and development resources | Paid parental leave | Paid time offSenior-level Full Time25 CANADA SQUARE CANARY WHARF, WEST …2d ago
-
AWS | Cloud Compliance | Data Architecture | Enterprise Architecture | Generative AICareer development resources | Flexible work hours | Knowledge sharing opportunities | Mentorship programsSenior-level Full TimeEdinburgh, Scotland, GBR2d ago