AI Inference Engineer
London, England, United Kingdom - Remote
R
GBP 80K-106K (estimate) Mid-level Full Time
Tasks
- Apply model optimization techniques
- Define inference serving strategy and architecture
- Design inference serving stack
- Implement request routing and batching
- Implement scheduling and autoscaling
- Integrate GPU and CUDA work into serving layer
- Own inference performance and reliability
- Select serving frameworks and orchestration
- Set standards tooling and benchmarks
- Translate performance commitments into capacity plans
Perks/Benefits
Skills/Tech-stack
Autoscaling | Batching | CUDA | Cache Management | Capacity Planning | Deep learning | GPU Computing | Inference Server | Inference Serving | KV cache | KV-cache management | Kubernetes | Latency optimization | Machine Learning | Model Optimization | Quantization | Request Routing | SGLang | Scheduling | Slurm | Speculative decoding | System Architecture | TensorRT-LLM | Throughput Optimization | Triton Inference | Triton Inference Server | VLLM
Education
N/A
Related jobs
-
Research Engineer - Data Infrastructure GBP 100K-180KData Augmentation | Data Curation | Data Deduplication | Data Pipelines | Data QualityAnnual company offsite | Learning and development stipend | Monthly co-working stipend | Social travel stipendMid-level Full TimeUnited Kingdom R2d ago
-
Research Engineer - Inference GBP 150K-300KBatching | CUDA | Inference Optimization | KV cache | Knowledge DistillationAnnual company offsite | Co-working stipend | Learning and development stipend | Remote work | Social travel stipendMid-level Full TimeUnited Kingdom R2d ago
-
C# | C++ | Distributed Systems | Experimentation | GoAccident insurance | Commuter benefits | Dental insurance | Disability insurance | Financial wellness supportSenior-level Full TimeCambridge, United Kingdom R2d ago
-
Azure Databricks Developer EUR 56KAgile | Apache Spark | Azure Data | Azure Data Factory | Azure Data LakeFlex benefits program | Income protection | Life assurance | Paid time off | Pension matchingMid-level Full TimeUK Wide, GB R2d ago
-
Applied AI Engineer GBP 60K-80KArtificial Intelligence | Backend Development | Distributed Systems | Haystack | JavaEquity | Learning and development budget | Work from abroadMid-level Full TimeBerlin R3d ago
-
Product Engineer, AI Email App GBP 140K-180KA/B | A/B Testing | B testing | Cost Optimization | ExperimentationMid-level Full TimeUnited Kingdom R3d ago
-
Product Lead, AI Email App GBP 100K-150KCost Optimization | Evaluation | Experiment design | Experimentation | Hallucination detectionSenior-level Full TimeUnited Kingdom R3d ago
-
Principal Software Engineer, AI Email App GBP 100K-160KAI workflow | AI workflow design | Backend APIs | Failure handling | Fallback mechanismsSenior-level Full TimeUnited Kingdom R3d ago
-
Lead Software Engineer, AI Email App GBP 100K-150KApplication development | Automated testing | Backend Development | CI/CD | Client Application DevelopmentSenior-level Full TimeUnited Kingdom R3d ago
-
Staff Software Engineer, AI Email App GBP 100K-173KAPI Development | Backend Development | Error Handling | LLM integration | Latency optimizationSenior-level Full TimeUnited Kingdom R3d ago
-
Senior-level Full TimeUnited Kingdom R3d ago
-
AI Architect_3195 GBP 60K-60KAI Governance | API Orchestration | AWS | Agents | ArchitectureDigital learning programs | Employee discounts | Employee shares program | Flexible working | Healthcare benefitsSenior-level Full TimeGuildford, ENG, GB, GU2 8XG R3d ago
-
AI Engineer_3194 GBP 55K-55KAccess Management | CI/CD | Compliance | Cost Management | Distributed tracingCareer Development Programs | Digital learning programs | Employee discounts | Employee shares program | Flexible workingSenior-level Full TimeGuildford, ENG, GB, GU2 8XG R3d ago
-
AI Engagement Manager_3195 GBP 45K-52KAgile | Artificial Intelligence | Business case | Business case development | Case DevelopmentCareer Development Programs | Company bonus scheme | Digital learning programs | Employee discounts | Employee shares programMid-level Full TimeGuildford, ENG, GB, GU2 8XG R3d ago
-
AWS | Agent Loops | Agent systems | Context Management | Distributed SystemsSenior-level Full TimeUnited Kingdom R3d ago
-
AI Engineer-Anthropic-University/Graduate Level - UK GBP 130K-180KAPI | Cloud Computing | Data Privacy | Docker | EmbeddingsMid-level Full TimeUK - Remote R3d ago
-
AI Systems & ML Engineering Industry Expert GBP 92K-120KA/B | A/B Testing | API Design | AWS | Agentic SystemsFlexible scheduling | Fully remote | Low time commitmentSenior-level Part TimeLondon, Greater London, GB R4d ago
-
Staff Machine Learning Engineer - Ops GBP 150K-163KCI/CD | GitHub Actions | Grafana | ML Pipeline | MLOpsHybrid work policySenior-level Full TimeLondon R4d ago
-
Machine Learning Engineer (Closed Loop) GBP 155K-163KDiffusion Models | Generative Modeling | Latent-video models | Machine Learning | Multi SensorHybrid work | Inclusive work environment | Publication opportunities | Work from homeMid-level Full TimeLondon R4d ago
-
Machine Learning Engineer (Synthetic Data) GBP 155K-163K3D Geometry | Autoregressive Video | Behaviour Cloning | Calibration | Camera GeometryHybrid work policyMid-level Full TimeLondon R4d ago
-
Senior Machine Learning Engineer GBP 115K-135KAmazon SageMaker | Bayesian Methods | C# | Data Versioning | Data handlingEnhanced parental leave | Fertility support | Flexible working | Free meals and snacks | Generous paid time offSenior-level Full TimeLondon (Shoreditch) R4d ago
-
Senior Field Specialist - Data Platform GBP 65K-89KAnsible Automation | Apache Airflow | Apache Impala | Apache Ozone | Apache SparkContinued Career Development | Employee resource groups | Flexible WFH | Generous PTO | Mental and physical wellness programsSenior-level Full TimeUK-Remote, United Kingdom R4d ago
-
AWS AI Engineer GBP 84K-109KAWS | Agile | Compliance | Data Governance | Data PipelinesHybrid working | Learning and development opportunities | Mental health support | Wellbeing appsSenior-level Full TimeManchester, GB R4d ago
-
Automated testing | CI/CD | Cloud platform | Cost Optimization | Fraud DetectionHybrid work | Training and development | Wellbeing programsMid-level Full TimeLondon, GB R4d ago
-
Agentic AI Architect-Anthropic-UK GBP 190K-230KAPIs | AWS | Alerting | Apache Spark | AuthenticationTravel to client sites | Travel to conferencesSenior-level Full TimeUK - Remote R4d ago