AI Inference Engineer
London, England, United Kingdom - Remote
R
GBP 80K-106K (estimate) Mid-level Full Time
Tasks
- Apply model optimization techniques
- Define inference serving strategy and architecture
- Design inference serving stack
- Implement request routing and batching
- Implement scheduling and autoscaling
- Integrate GPU and CUDA work into serving layer
- Own inference performance and reliability
- Select serving frameworks and orchestration
- Set standards tooling and benchmarks
- Translate performance commitments into capacity plans
Perks/Benefits
Skills/Tech-stack
Autoscaling | Batching | CUDA | Cache Management | Capacity Planning | Deep learning | GPU Computing | Inference Server | Inference Serving | KV cache | KV-cache management | Kubernetes | Latency optimization | Machine Learning | Model Optimization | Quantization | Request Routing | SGLang | Scheduling | Slurm | Speculative decoding | System Architecture | TensorRT-LLM | Throughput Optimization | Triton Inference | Triton Inference Server | VLLM
Education
N/A
Related jobs
-
Senior Machine Learning Engineer GBP 75K-90KAWS | Azure | Cloud Architecture | Cloud platform | DockerCoaching | Dental insurance | Enhanced parental leave | Flexible working | Hybrid workingSenior-level Full TimeUK - Remote R1d ago
-
Senior Software Engineer, Embedded UI GBP 75K-90KAI | API Design | BrightScript | JavaScript | Language ModelsCommuter benefits | Dental insurance | Disability insurance | Financial wellness support | Health insuranceSenior-level Full TimeManchester, United Kingdom R2d ago
-
Senior Software Engineer, Training & Experimentation USD 180K-250KAPI Development | AWS | Asynchronous processing | Automated testing | Azure401k matching | Company holidays | Company winter break | Dental coverage | Flexible scheduleSenior-level Full TimeLondon, England, United Kingdom; New York, … R2d ago
-
Data Engineer III GBP 80K-90KAWS | Automated testing | CI/CD | CockroachDB | DBTCo-working space access | Company retreat | Equipment stipend | Fully remote | Home office stipendSenior-level Full TimeUnited Kingdom R3d ago
-
AI Inference Tools Engineer USD 167K-242KAgent Frameworks | Benchmarking | C++ | CUDA | Dashboards401k matching | Flexible paid time off | Health insurance | Hybrid work options | Local meetupsSenior-level Full TimeUnited States, United Kingdom R3d ago
-
Senior AI Solution Engineer GBP 65K-75KAPI Integration | Bias Mitigation | CI/CD | Cloud Computing | ContainerizationBenefits package | Career growth | Hybrid working | Mentorship | Ongoing developmentSenior-level Full TimeWarminster, Wiltshire, United Kingdom R3d ago
-
Senior Machine Learning Engineer (3967) GBP 72K-85KAnomaly Detection | CI/CD | Classification | Clustering | Computer VisionAgile environment | Knowledge sharing | MentorshipSenior-level Full TimeUnited Kingdom - Remote R3d ago
-
Applied Scientist, Intelligent Talent Acquisition - Lead Generation & Detection Services GBP 80K-122KA/B | A/B Testing | B testing | C++ | Data MiningSenior-level Full TimeEdinburgh, Scotland, GBR R3d ago
-
AI Engineer - London, UK GBP 78K-90KAI ethics | Artificial Intelligence | Cloud Computing | Data Privacy | Generative AIAccess to training courses | Hybrid working | Learning and development opportunities | Wellbeing programsMid-level Full TimeLondon, GB R3d ago
-
AWS | Azure | Bayesian Methods | Clustering | Data GovernanceFlexible work schedule | In office collaboration 4 days per week | One day per week remote work | Permanent employmentSenior-level Full Time47053 Threadneedle - London - 35, … R3d ago
-
Director, AI Engagements USD 270K-325KAPI Integration | Agentic Workflows | Artificial Intelligence | Claude API | Data FlowExecutive-level Full TimeRemote, United States; UK - Remote R3d ago
-
Legal AI Program Manager USD 315K-385KArtificial Intelligence | Change Management | Enterprise Architecture | Enterprise Software | EvaluationMid-level Full TimeRemote, United States; UK - Remote R3d ago
-
Senior AI Data Scientist GBP 92K-173KA/B | A/B Testing | Analytics | B testing | Causal InferenceCareer growth opportunities | Remote work | Travel opportunitiesSenior-level Full TimeEurope, GB R4d ago
-
Technical Architect - ML GBP 75K-110KA/B | A/B Testing | API Gateway | AWS | AWS BedrockCareer development | Great Place to Work recognition | Learning and growth | Mentorship | Remote workSenior-level Full TimeUK London, United Kingdom R4d ago
-
Senior Full Stack AI Engineer GBP 92K-173KAI Agents | AWS | CI/CD | Distributed Systems | EmbeddingsCareer growth | Remote work | Travel 30 percentSenior-level Full TimeEurope, GB R4d ago
-
Senior ML Engineer (AI Research/ Portability) GBP 190K-230KAPI Design | Agent systems | Authentication | CI/CD | Code reviewCareer growth | Collaborative culture | Flexibility | International environment | Learning opportunitiesSenior-level Full TimeAmsterdam, Netherlands; Remote - Europe; United … R4d ago
-
Senior ML Engineer (AI Research, Physical AI) GBP 92K-173KComputer Vision | Control | Deep learning | Distributed Computing | Distributed TrainingCareer growth and learning opportunities | Collaborative culture | Flexibility | International environment | OwnershipSenior-level Full TimeAmsterdam, Netherlands; Remote - Europe; United … R4d ago
-
Principal Machine Learning Engineer GBP 78K-98KData Science | Deep learning | Enterprise Integration | Machine Learning | Requirements AnalysisCoaching | Dental insurance | Enhanced parental leave | Flexible working | Hybrid workingSenior-level Full TimeUK - Remote R5d ago
-
Senior Machine Learning Engineer GBP 75K-85KAPIs | Anomaly Detection | Cloud Computing | Control | Deep learningBike to work scheme | Employee assistance program | Employer pension contribution | Enhanced parental leave | Equity optionsSenior-level Full TimeLondon, United Kingdom R5d ago
-
Head of AI Transformation Portfolio GBP 120K-209KAI Governance | Artificial Intelligence | Change Management | Cloud infrastructure | Data strategyHybrid work model | Workplace flexibilityExecutive-level Full TimeLondon, United Kingdom R5d ago
-
AI/ML Specialist Solutions Architect GBP 90K-120KC++ | Distributed Training | Docker | Git | GoCareer growth and learning opportunities | Collaborative culture | Flexibility | International environment | Opportunity to work on impactful AI projectsSenior-level Full TimeAmsterdam, Netherlands; Finland; France; Germany; Netherlands; … R6d ago
-
Fullstack Machine Learning Developer (Junie) GBP 100K-131KAgent workflows | Command Line | Command-line Interface | Cost Optimization | Language ModelsExtra time off | Gym or Sports Stipend | Language classes | Learning and development | Lunch allowanceMid-level Full TimeAmsterdam, Netherlands; Belgrade, Serbia; Berlin, Germany; … R7d ago
-
Senior Machine Learning Engineer GBP 80K-126KAPI serving | Agentic LLM | Automated testing | CI/CD | DockerContributory pension scheme | Enhanced maternity and adoption pay | Private healthcareSenior-level Full TimeLondon, United Kingdom R10d ago
-
Agent Frameworks | Code Quality | Deep learning | Deployment | LLM applicationMid-level Full TimeLondon - Baker, United Kingdom R10d ago
-
Technical Consultant - Data & AI GBP 65K-75KAzure | Azure AI | Azure Data | Azure Data Factory | Azure InfrastructureHybrid workingMid-level Full TimeUnited Kingdom - Remote R10d ago