Staff Software Engineer, Inference
Tasks
- Build performance benchmarking frameworks
- Create observability and reliability practices
- Design autoscaling strategies
- Drive inference platform architecture
- Establish SLIs and SLOs
- Implement adaptive scheduling
- Implement speculative decoding
- Improve P99 tail latency
- Manage GPU resources
- Mentor engineers
- Optimize request routing
- Perform capacity planning
- Reuse KV cache
Perks/Benefits
- Critical illness cover
- Employee assistance programme
- Family dental insurance
- Family medical insurance
- Life assurance
- Pension contribution
- Tuition reimbursement
- Work culture focused on innovative disruption
Skills/Tech-stack
Autoscaling | BF16 | Benchmarking | C++ | CUDA | Caching | Capacity Planning | Distributed Systems | FP8 | Go | Inference Systems | KV cache | Kubernetes | Memory Optimization | Metrics | Micro Batching | Mixed Precision | NCCL | NUMA | Networking | Performance optimization | Python | RDMA | Ray Serve | SLI | SLO | Speculative decoding | Streaming | TensorRT-LLM | Torchserve | Triton | VLLM
Education
Roles
Related jobs
-
Senior Data Analytics Engineer GBP 85K-95KAggregate Functions | BigQuery | CI | CTE | DBTRemote-flexible work | Team in person London every 6 to 8 weeksSenior-level Full TimeLondon, United Kingdom R1d ago
-
Commodity Trading Analytics Internship Program GBP 50K-60KData Analysis | Data Visualization | Excel | Financial Modeling | ForecastingCohort based learning | Mentorship | On-site internshipEntry-level InternshipLondon, United Kingdom1d ago
-
DVP Data Engineer GBP 45K-55KAccelerometer | Automotive Engineering | Data Analysis | Data Visualization | Data acquisitionCareer development opportunities | Company events | Company pension | Free refreshments | On-site parkingMid-level Full TimeDaventry, England, GB2d ago
-
Senior Software Engineer - AI Solutions GBP 58K-85KDeveloper experience | Django | LLM | Python | Retrieval-Augmented GenerationFlexible work environment | Interview accommodations | Mentorship culture | Relocation supportSenior-level Full TimeLondon (GB)2d ago
-
Data Engineering | Dataset curation | Evaluation | Experimentation | Language ModelsSenior-level Full TimeUnited Kingdom, London, London2d ago
-
Senior Machine Learning Engineer GBP 28K-30KAlerting | Algorithms | Apache Spark | BigQuery | Cloud ComputingAnnual bonus scheme | Bank holidays | Employee assistance programme | Free 247 virtual GP service | Holiday Starting At 25 DaysSenior-level Full TimeWelwyn Garden City, United Kingdom of …2d ago
-
Applied AI ML Data Scientist, Vice President - Payments GBP 100K-186KAPIs | AWS | Agent systems | Audit documentation | Automated testingExecutive-level Full TimeLONDON, United Kingdom2d ago
-
Senior Data Science Lead - AML Risk GBP 75K-115KData Pipelines | Data labeling | Experiment design | GenAI | Machine LearningSenior-level Full TimeLondon, United Kingdom2d ago
-
Senior Embedded Software Engineer GBP 60K-65KAgile | C# | C++ | CAN | CI/CDCareer growth | Health and wellbeing support | Inclusive workplace | On-site flexibility | Training opportunitiesSenior-level Full TimeHemel Hempstead, England, United Kingdom2d ago
-
Senior Embedded Software Engineer (All Genders) GBP 45K-68KC# | C++ | CAN | CMake | DTSInclusive supportive environment for Armed Forces community | UK Security clearance supportSenior-level Full TimeSwindon2d ago
-
Research Engineer - Data Infrastructure GBP 100K-180KData Augmentation | Data Curation | Data Deduplication | Data Pipelines | Data QualityAnnual company offsite | Learning and development stipend | Monthly co-working stipend | Social travel stipendMid-level Full TimeUnited Kingdom R2d ago
-
AWS | Airflow | Application design | Automated testing | CI/CDExecutive-level Full TimeLONDON, United Kingdom2d ago
-
Research Engineer - Inference GBP 150K-300KBatching | CUDA | Inference Optimization | KV cache | Knowledge DistillationAnnual company offsite | Co-working stipend | Learning and development stipend | Remote work | Social travel stipendMid-level Full TimeUnited Kingdom R2d ago
-
Data Platform Engineer, London GBP 71K-73KBioinformatics | Cloud platform | Computational Chemistry | DBT | Data EngineeringHybrid workMid-level Full TimeLondon2d ago
-
Embedded Electronics & Firmware Engineer GBP 45K-50KATEX | Altium | Analog design | C# | C++Additional birthday leave | Cash plan | Death in service | Employee assistance programme | Flexible work hoursMid-level Full TimeWitney, United Kingdom2d ago
-
C# | C++ | Distributed Systems | Experimentation | GoAccident insurance | Commuter benefits | Dental insurance | Disability insurance | Financial wellness supportSenior-level Full TimeCambridge, United Kingdom R2d ago
-
Bash | Cloud platform | Data Processing | Docker | Google CloudMid-level Full TimeManchester, United Kingdom2d ago
-
Bash | Cloud platform | Data Ingestion | Data Processing | DockerMid-level Full TimeNewcastle, United Kingdom2d ago
-
Azure Databricks Developer EUR 56KAgile | Apache Spark | Azure Data | Azure Data Factory | Azure Data LakeFlex benefits program | Income protection | Life assurance | Paid time off | Pension matchingMid-level Full TimeUK Wide, GB R2d ago
-
Entry-level ContractLeeds, England, United Kingdom2d ago
-
Data Engineer GBP 26K-26KAgile | Azure Data | Azure Data Factory | Azure Databricks | Azure Key VaultAnnual discretionary bonus | Annual leave | Bank holidays | Cycle to work initiative | Discounted gym membershipMid-level Full TimeSkipton - The Bailey, United Kingdom R2d ago
-
Sr Advisor, Commercial Data Engineering GBP 60K-85KAzure Data | Azure Data Factory | Azure DevOps | DBT | DashSenior-level Full TimeLondon, GB2d ago
-
AWS | Advanced Analytics | Databricks | Deployment | Machine LearningEntry-level Full TimeGlasgow Campus, United Kingdom2d ago
-
AI Engineer GBP 100K-131KAgents | Embeddings | Evaluation | LLM | MCPCoaching | Equity participation program | Family leave plus | Health benefits | Language trainingSenior-level Full TimeLondon, England, United Kingdom (Hybrid) R2d ago
-
Senior-level Full TimeLondon2d ago