AI Evaluation & Assurance Architect
GBP 81K-109K (estimate) Senior-level Full Time
Tasks
- Build reference architectures
- Collaborate with product managers and stakeholders
- Conduct adversarial testing
- Create governance evidence
- Define evaluation standards
- Design AI assurance processes
- Ensure auditability
- Identify and incorporate new technologies
- Implement continuous monitoring
- Lead evaluation framework design
- Mentor engineering teams
- Operationalize AI evaluations
- Prevent data leakage
- Set CI CD gating
- Support bias mitigation
- Support hallucination testing
- Translate AI risks into controls
Perks/Benefits
- N/A
Skills/Tech-stack
Adversarial Testing | Artificial Intelligence | Auditability | Bias Mitigation | CI/CD | Confidence metrics | Continuous Monitoring | Control Design | Data Leakage Prevention | Data leakage | Evaluation | Generative AI | Governance | Hallucination Testing | LLMOps | Leakage prevention | Machine Learning | Model Risk Management | Model risk | Observability | Probabilistic Modeling | Release gates | Risk Assessment | Risk Management | Scoring | Simulation | Statistics | Synthetic data | Test Dataset
Education
N/A
Roles
Related jobs
-
Senior Associate, IT, AI Engineer (Mid Level) GBP 70K-90KAWS | AWS Strands | Agent Frameworks | Agent Service | Azure AIHybrid working | Learning and development | Supportive team environmentMid-level Full TimeLondon, England, United Kingdom10h ago
-
AI Solution Architect/ Engineer - Senior Manager GBP 72K-90KAWS Bedrock | Agile methodology | Amazon SageMaker | Artificial Intelligence | Azure Machine LearningPrivate medical cover | Qualified Virtual GP | Volunteering daysSenior-level Full TimeLondon - 7 Morelondon Riverside, United …22h ago
-
Applied AI Engineer GBP 100K-125KASR | Adversarial Testing | Azure | Barge In | ElevenLabsHybrid work | In-person work | Remote workMid-level Full TimeRemote (UK), United Kingdom R22h ago
-
Applied AI ML Associate GBP 78K-109KCI/CD | Compliance | Data pipeline | Database Design | Database ModelingGuidance from technical mentors | Learning and growthEntry-level Full TimeLONDON, LONDON, United Kingdom1d ago
-
Principal Data and AI Architect GBP 78K-103KA2A | APIs | AWS SageMaker | Agent interoperability | Agent lifecycleSenior-level Full TimeUnited Kingdom - London1d ago
-
AI Engineer - Contract Inside IR35 - 3-6 months GBP 70K-80KAPIs | CI/CD | Computer Vision | DevOps | Distributed SystemsSenior-level Full TimeLondon, England, United Kingdom1d ago
-
AI Research Engineer GBP 60K-63KArtificial Intelligence | Azure DevOps | Data Preparation | Docker | GitHub ActionsBonus scheme | Car scheme | Company pension scheme | On-site gym | Private health careMid-level Full TimeGB REN ALPINERLMTD - Enstone, United …1d ago
-
AI Research Engineer GBP 60K-63KAzure DevOps | Data Exploration | Docker | Feature Engineering | GitHub ActionsBonus scheme | Car scheme | Company contributed pension scheme | On-site gym | Private health care coverMid-level Full TimeGB REN ALPINERLMTD - Enstone, United …1d ago
-
AI Governance | Artificial Intelligence | Curriculum Development | Digital Transformation | Language ProcessingCollaborative culture | Exposure to innovative initiatives | Professional development opportunitiesSenior-level Contract Full TimeLondon, England, United Kingdom - Remote R1d ago
-
Quant AI/ML Model Developer VP GBP 124K-169KCloud Platforms | Data Pipelines | Generative AI | Language Models | Large Language ModelsExecutive-level Full TimeCanary Wharf, 1 Churchill Place, United …1d ago
-
GEN AI Architect GBP 84K-109KAI Governance | Artificial Intelligence | Data Architecture | Data Governance | Data ManagementSenior-level Full TimeKnutsford, Radbroke Hall, United Kingdom1d ago
-
Machine Learning Engineer GBP 72K-87KAWS | Anomaly Detection | Apache Spark | Azure | Cloud ComputingMid-level Full TimeGlasgow Campus, United Kingdom1d ago
-
Software Engineer GBP 78K-109KCI/CD | Cloud Computing | Code review | Collaborative Problem Solving | DevOpsMid-level Full TimeKnutsford, Radbroke Hall, United Kingdom1d ago
-
Data Engineer / AI Engineer GBP 50K-65KAI APIs | AWS S3 | Anomaly Detection | Apache Airflow | AzureMid-level Full TimeGBR - Bracknell - Park Road …1d ago
-
AI Engineering Intern GBP 30K-30KArtificial Intelligence | Machine Learning | PythonEquipment provided | Mentorship | Remote work optionEntry-level InternshipCambridge, England, United Kingdom2d ago
-
Head of AI Enablement and Transformation Delivery GBP 120K-150KArtificial Intelligence | Automation | Business Transformation | Data | Machine LearningEmployee discount | Employee sample sales | Paid annual leave | Personalized learning | Private medical careExecutive-level Full TimeLondon, England, United Kingdom4d ago
-
Head of AI Transformation GBP 90K-250KAI Governance | AI strategy | Artificial Intelligence | Business Process | Business process improvementBonus | Healthcare support | Professional development | Sharesave scheme | Wellbeing supportExecutive-level Full TimeLondon, England, United Kingdom4d ago
-
Automation | Data Cleansing | Data Infrastructure | Data Matching | Data PipelinesFixed-term contract | High-visibility projectEntry-level Contract TemporaryLondon, United Kingdom4d ago
-
AI Engineer GBP 40K-45KAPI Integration | AWS | Amazon Bedrock | Amazon SageMaker | CI/CD25 Paid Days Annual Leave | Cycle to work scheme | Dental insurance options | Employee discounts | Group Personal Pension SchemeMid-level Full TimeGBR-4PS, United Kingdom4d ago
-
System Architect - Robotaxi GBP 90K-120KADAS | AI | Automotive middleware | Autonomous Driving | Compute architectureHybrid work policySenior-level Full TimeLondon5d ago
-
Lead Software Developer (AI Solutions) GBP 24K-24K.NET | AI Agent | AI agent orchestration | API Development | Agent OrchestrationCareer support | Inclusive culture | Professional developmentSenior-level Full TimeOxford, England, United Kingdom5d ago
-
AI Solution Architect GBP 78K-109KAWS | Architecture Diagrams | Artificial Intelligence | Asset Management | AutomationSenior-level Full TimeRemote - Canada; Remote - Portugal; … R5d ago
-
AI Deployment Engineer, Large Enterprise GBP 90K-115KAPI Integration | ChatGPT | Cloud deployment | Enterprise Architecture | Generative AIHybrid work model | Relocation assistanceSenior-level Full TimeLondon, UK5d ago
-
Director, AI-Enabled Business Solutions GBP 130K-250KAgile delivery | Artificial Intelligence | Automation | Cloud Computing | ComplianceAccelerated career path | Career growth opportunities | Flexible work environment | Gym membership reimbursement | LinkedIn Learning subscriptionExecutive-level Full TimeLondon, United Kingdom5d ago
-
Agentic AI | CUDA | Generative AI | Grant Writing | Language ModelsSenior-level Full TimeUK, Remote, United Kingdom R5d ago