AI Inference Engineer
London, England, United Kingdom - Remote
R
GBP 80K-106K (estimate) Mid-level Full Time
Tasks
- Apply model optimization techniques
- Define inference serving strategy and architecture
- Design inference serving stack
- Implement request routing and batching
- Implement scheduling and autoscaling
- Integrate GPU and CUDA work into serving layer
- Own inference performance and reliability
- Select serving frameworks and orchestration
- Set standards tooling and benchmarks
- Translate performance commitments into capacity plans
Perks/Benefits
Skills/Tech-stack
Autoscaling | Batching | CUDA | Cache Management | Capacity Planning | Deep learning | GPU Computing | Inference Server | Inference Serving | KV cache | KV-cache management | Kubernetes | Latency optimization | Machine Learning | Model Optimization | Quantization | Request Routing | SGLang | Scheduling | Slurm | Speculative decoding | System Architecture | TensorRT-LLM | Throughput Optimization | Triton Inference | Triton Inference Server | VLLM
Education
N/A
Related jobs
-
Senior Staff Engineer (LLM) GBP 80K-109KAgent systems | Anthropic API | Authentication | Chunking | EmbeddingsSenior-level Full TimeRemote, United Kingdom R11h ago
-
Member of Technical Staff (Applied AI) GBP 90K-160KArtificial Intelligence | Language Models | Large Language Models | Machine Learning | Model IntegrationDental insurance | Healthcare benefits | Paid time off | Visa support | Vision insuranceSenior-level Full TimeUS, UK, Remote R1d ago
-
Data Platform Engineer GBP 75K-90KApache Airflow | Apache Iceberg | BigQuery | Cloud Composer | Cloud platformCareer development opportunities | Distributed team | International environment | Remote-first work | Welcoming supportive teamSenior-level Full TimeUnited Kingdom - Remote R1d ago
-
AWS | Big Data | Data Analysis | Hadoop | JavaGlobal team collaboration | Professional development | Remote workSenior-level Full TimeLondon, United Kingdom R4d ago
-
Engineering - Internal AI Transformation USD 74K-110KAPIs | Agentic Workflows | Auditability | Authentication | DockerAnnual company offsite | Co-working stipend | Learning and development stipend | Social travel stipendEntry-level Full TimeUnited States R4d ago
-
Associate/Vice President, AI Infrastructure Engineer GBP 180K-250KAWS | AWS Bedrock | Access Management | Alerting | AzureEducation reimbursement | Family support programs | Flexible time off | Health benefits | Retirement investmentExecutive-level Full TimeED3 - 20 Brandon Street, Edinburgh, … R4d ago
-
Forward Deployed Engineer GBP 59K-81KBash | Data Pipelines | Docker | Go | JavaScriptFlexible work arrangements | Generous PTO | Professional development funds | Sick leaveMid-level Full TimeUK - Remote, United Kingdom R4d ago
-
Senior Data Engineer GBP 74K-74KAgile | Apache Parquet | Apache Spark | Azure | Continuous ImprovementCycle to work scheme | EV scheme | Employee assistance programme | Employee referral bonus | Enhanced parental leaveSenior-level Full TimeLondon, England, United Kingdom R5d ago
-
Head of AI Governance GBP 98K-133KAI Act | AI Agents | AI Governance | AI RMF | APICompany Paid Life Cover | Employee assistance program | Pension or retirement plan | Private medical | Wellness benefitsExecutive-level Full TimeRemote - United Kingdom R6d ago
-
Prompt Engineer GBP 35K-50KAI Agents | Compliance | Data Privacy | LLM providers | Language ModelsBike purchase discount | Coaching | Enhanced parental leave | Gym membership | Healthcare coverageEntry-level Full TimeLondon R6d ago
-
Bioinformatics Engineer, London GBP 73K-73KApache Beam | Cloud platform | Dagster | DataFrame | Google CloudHybrid workingMid-level Full TimeLondon R6d ago
-
Senior Audio AI Research Engineer GBP 90K-110KAWS | Acoustic simulation | Audio signal processing | C++ | Data IngestionHybrid work | Work from homeSenior-level Full TimeLondon, United Kingdom R7d ago
-
CI/CD | ClearML | Containerization | Continuous integration | Curriculum learningFlexible work arrangement | Hybrid work model | Learning opportunities | On-the-job coaching | Work-life balanceMid-level Full TimeUnited Kingdom, London R7d ago
-
AI Engineer - FDE (Forward Deployed Engineer) GBP 80K-110KAWS | Apache Spark | Azure | Cloud platform | Data EngineeringConference presentations | Remote work | Travel opportunitiesSenior-level Full TimeRemote - United Kingdom R9d ago
-
Data Science Lead GBP 85K-115KA/B | A/B Testing | Attribution Modeling | Automated retraining | B testingAdoptive parents pay | Enhanced parental leave | Female health leave | Fully paid sabbatical | Hybrid work 3 days per week in officeSenior-level Full TimeLondon R12d ago
-
Forms & Precedents AI Optimization Lead GBP 78K-108KArtificial Intelligence | Content Operations | Cross-Functional Collaboration | Cross-functional | Data AnalysisSabbatical | Shared parental leave | Study assistance | Wellbeing initiativesSenior-level Full TimeHome Based - United Kingdom R12d ago
-
Forms & Precedents AI Optimization Lead GBP 78K-108KArtificial Intelligence | Automation | Content Optimization | Cross-Functional Collaboration | Cross-functionalFlexible working hours | Sabbatical | Shared parental leave | Study assistanceSenior-level Full TimeHome Based - United Kingdom R12d ago
-
Machine Learning Engineer (Remote) GBP 401KConcurrency | Data Pipelines | Data Processing | Data Structures | Distributed SystemsConference budget | Health benefits | Mental health care program | Paid time off | Parental leaveMid-level Full TimeUnited Kingdom R12d ago
-
Graduate Analytics Engineer GBP 30K-32KAI | DBT | Data Modeling | Data Transformation | Data pipelineCycle to work scheme | Electric vehicle salary sacrifice | Employee referral bonus | Flexible working | Office meals and snacksEntry-level Full TimeLondon R13d ago
-
Machine Learning Engineer, ADAS GBP 123K-130K3D Perception | 3D Reconstruction | Auto-labeling | Computer Vision | Data PipelinesDental insurance | Enhanced maternity leave | Enhanced paternity leave | Health insurance | Hybrid workingMid-level Full TimeLondon R14d ago
-
Alerting | Anthropic | Distributed Systems | Docker | EmbeddingsFully remote | High ownership culture | Learning and development budget | Modern engineering practicesSenior-level Full TimeUnited Kingdom R14d ago
-
AI Research Engineer GBP 115K-200KC# | CUDA | Deep learning | Machine Learning | PyTorchHybrid Remote | Meeting-free days | Remote flexibilityMid-level Full TimeHybrid (UK) R14d ago
-
Machine Learning Engineer GBP 72K-85KCI/CD | Deep learning | Docker | Git | JupyterCareer growth | Flexible working hours | Hybrid work | Inclusive work environmentSenior-level Full TimeLondon, UK R14d ago
-
Associate AI Solutions Architect GBP 70K-95KAPIs | Data Structures | Databases | Generative AI | Language ModelsAugust Free Fridays | Employee learning programs | Flexible working hours | Paid volunteer time | Well-being resourcesMid-level Full TimeVirtual Office (United Kingdom) R14d ago
-
Senior AI Engineer GBP 75K-75KAWS | Agent systems | Artificial Intelligence | CI/CD | Cloud ComputingAnnual bonus | Discounted gym membership | Electric vehicle leasing | Experience days | Hybrid workSenior-level Full TimeLondon, United Kingdom R15d ago