Staff Software Engineer, Inference
Tasks
- Build performance benchmarking frameworks
- Create observability and reliability practices
- Design autoscaling strategies
- Drive inference platform architecture
- Establish SLIs and SLOs
- Implement adaptive scheduling
- Implement speculative decoding
- Improve P99 tail latency
- Manage GPU resources
- Mentor engineers
- Optimize request routing
- Perform capacity planning
- Reuse KV cache
Perks/Benefits
- Critical illness cover
- Employee assistance programme
- Family dental insurance
- Family medical insurance
- Life assurance
- Pension contribution
- Tuition reimbursement
- Work culture focused on innovative disruption
Skills/Tech-stack
Autoscaling | BF16 | Benchmarking | C++ | CUDA | Caching | Capacity Planning | Distributed Systems | FP8 | Go | Inference Systems | KV cache | Kubernetes | Memory Optimization | Metrics | Micro Batching | Mixed Precision | NCCL | NUMA | Networking | Performance optimization | Python | RDMA | Ray Serve | SLI | SLO | Speculative decoding | Streaming | TensorRT-LLM | Torchserve | Triton | VLLM
Education
Roles
Related jobs
-
Data Science Specialist GBP 70K-80KArtificial Intelligence | CI/CD | Containers | Data Analysis | Exploratory Data AnalysisDental coverage | Gym membership discount | Healthcare discount | Holiday purchase scheme | Paid carer’s leaveSenior-level Full TimeChelmsford, GB, CM1 1NP4h ago
-
Senior Software Engineer, Embedded UI GBP 75K-90KAI | API Design | BrightScript | JavaScript | Language ModelsCommuter benefits | Dental insurance | Disability insurance | Financial wellness support | Health insuranceSenior-level Full TimeManchester, United Kingdom R4h ago
-
AWS | Agent Orchestration | Agent systems | Azure | Cloud platformContributory pension scheme | Employer pension contribution | Enhanced Adoption Pay | Enhanced maternity pay | Private healthcareMid-level Full TimeSheffield, GB, S1 4NB11h ago
-
Agentic Systems | Distributed Systems | Language Models | Large Language Models | RubyEmployee stock purchase plan | Equity compensation | Flexible paid time off | Growth and development fund | Parental leaveSenior-level Full TimeRemote, United Kingdom R12h ago
-
Bash | Data Processing | Docker | GCP | Infrastructure as CodeMid-level Full TimeLondon, United Kingdom12h ago
-
Bash | Cloud platform | Data Ingestion | Data Processing | DockerAsynchronous culture | Remote-friendly, distributed teamMid-level Full TimeBrighton, United Kingdom12h ago
-
Machine Learning Intern GBP 40K-62KComputer Vision | Diffusion Models | Fine Tuning | LLM Fine-tuning | Language ProcessingFlexible start date | Full time or part time | Paid internshipEntry-level InternshipLondon,England,United Kingdom20h ago
-
Embedded Software Engineer GBP 55K-62KAgile | C++ | Confluence | DO-178C | DOORSCycle and tech scheme | Employee assistance programme | Flexible working | Life insurance | Pension schemeMid-level Full TimeGlasgow, Scotland, United Kingdom21h ago
-
Scientific Data Engineer - Product Safety GBP 70K-74KAWS | Apache Spark | CI/CD | Data Lakehouse | Data ModelingAnnual paid leave | Life insurance | Pension scheme | Private medical insurance | Work-life balanceSenior-level Full TimeBracknell, BERKSHIRE, United Kingdom23h ago
-
Quantitative Developer - Python GBP 40K-50KData cleaning | Financial markets | Machine Learning | Python | Software developmentWork-life balance initiativesMid-level Full TimeLondon23h ago
-
Data Engineer III GBP 80K-90KAWS | Automated testing | CI/CD | CockroachDB | DBTCo-working space access | Company retreat | Equipment stipend | Fully remote | Home office stipendSenior-level Full TimeUnited Kingdom R1d ago
-
Security Analytics Engineer GBP 72K-80KCI/CD | DBT | Data Governance | Data Lineage | Data Modeling25 days holiday per year | Access to cycle garage and showers | Dental scheme | Free soft drinks | Hybrid workingSenior-level Full TimeUnited Kingdom, London R1d ago
-
AI Engineer (Agentic Systems) GBP 78K-109KAgent Orchestration | CI/CD | Cloud APIs | Code review | Guardrails24 7 GP helpline | Continuous L and D | Flexible working environment | Healthcare coverage | Mental health supportMid-level Full TimeBelfast, Northern Ireland, United Kingdom1d ago
-
Production Engineer GBP 74K-100KAPI | C++ | Distributed Systems | Java | Load BalancingOn-call rotationMid-level Full TimeLondon, UK1d ago
-
Product Content Engineer GBP 55K-90KA/B | A/B Testing | AI Evaluation | B testing | Bias MitigationSenior-level Full TimeLondon, UK1d ago
-
APIs | Agent systems | Cloud Security | Cloud platform | CrewAISenior-level Full TimeLondon, UK1d ago
-
Apache Spark | Azure Data | Azure Data Factory | Azure DevOps | Azure Machine LearningEmployer pension matching | Hybrid work | Paid time off | Private medical insuranceSenior-level Full TimeAlderley Edge, GB1d ago
-
AI Inference Tools Engineer USD 167K-242KAgent Frameworks | Benchmarking | C++ | CUDA | Dashboards401k matching | Flexible paid time off | Health insurance | Hybrid work options | Local meetupsSenior-level Full TimeUnited States, United Kingdom R1d ago
-
Senior Applied Scientist GBP 92K-130KCloud | Complex Planning | Data Analysis | Dataset Processing | Deep learningHybrid work option | Learning and development | Remote work flexibility | Stock options | Team meetupsSenior-level Full TimeLondon1d ago
-
Senior AI Solution Engineer GBP 65K-75KAPI Integration | Bias Mitigation | CI/CD | Cloud Computing | ContainerizationBenefits package | Career growth | Hybrid working | Mentorship | Ongoing developmentSenior-level Full TimeWarminster, Wiltshire, United Kingdom R1d ago
-
Senior Machine Learning Engineer (3967) GBP 72K-85KAnomaly Detection | CI/CD | Classification | Clustering | Computer VisionAgile environment | Knowledge sharing | MentorshipSenior-level Full TimeUnited Kingdom - Remote R1d ago
-
Associate Principal Embedded Software Engineer GBP 55K-58KARM | Agile | Analog-to-digital conversion | Assembly | AtlassianAdditional holiday purchase | Dental insurance | Digital GP | Employee assistance program | Fertility treatment supportMid-level Full TimeUnited Kingdom - Malmesbury Office1d ago
-
Senior Embedded Software Engineer GBP 45K-60KARM | Agile | Assembly | Atlassian Jira | Battery ManagementDental insurance | Digital GP | Discounts | Employee assistance programme | Fertility treatment supportSenior-level Full TimeUnited Kingdom - Malmesbury Office1d ago
-
Data Engineer GBP 69K-94KApache Airflow | Apache Spark | Azure | Batch Processing | Data LakesAccessibility accommodations | Critical illness cover | Flexible hybrid work environment | Holiday allowance | Life insuranceEntry-level Full TimeManchester, United Kingdom R1d ago
-
Senior Quantitative Engineer, Systematic Cross Commodity GBP 100K-130KApache Kafka | C++ | CI/CD | Ceph | Data ProcessingSenior-level Full TimeLondon, United Kingdom1d ago