Senior Software Engineer, Inference Platform
London, England, United Kingdom
GBP 225K-325K (estimate) Senior-level Full Time
Tasks
- Architect inference platform components
- Build deployment pipelines
- Build observability telemetry stack
- Conduct code reviews
- Debug production distributed systems
- Design inference service platform
- Implement low latency high throughput inference
- Implement model routing and canary deployments
- Implement monitoring and alerting
- Improve testing and documentation
- Optimize GPU utilization and cold start
- Optimize inference pipelines for batching and throughput
Perks/Benefits
Skills/Tech-stack
API Gateway | Authentication | Authorization | Autoscaling | Batching | C++ | Distributed Systems | Distributed tracing | Docker | Event Driven | Event-driven architecture | GPU Computing | Golang | Grafana | High Throughput | Infrastructure as Code | Kafka | Kubernetes | Latency optimization | Load Balancing | Low Latency | Microservices | Multi-tenancy | OpenTelemetry | PostgreSQL | Prometheus | Python | Quantization | RabbitMQ | Rate Limiting | Redis | Resource scheduling | Rust | TensorRT | TensorRT-LLM | Text Generation | Text generation inference | VLLM | “as-code”
Education
N/A
Related jobs
-
Senior-level Full TimeLondon, UK1d ago
-
Data Science Specialist GBP 70K-80KArtificial Intelligence | CI/CD | Containers | Data Analysis | Exploratory Data AnalysisDental coverage | Gym membership discount | Healthcare discount | Holiday purchase scheme | Paid carer’s leaveSenior-level Full TimeChelmsford, GB, CM1 1NP1d ago
-
Senior Software Engineer, Embedded UI GBP 75K-90KAI | API Design | BrightScript | JavaScript | Language ModelsCommuter benefits | Dental insurance | Disability insurance | Financial wellness support | Health insuranceSenior-level Full TimeManchester, United Kingdom R1d ago
-
AWS | Agent Orchestration | Agent systems | Azure | Cloud platformContributory pension scheme | Employer pension contribution | Enhanced Adoption Pay | Enhanced maternity pay | Private healthcareMid-level Full TimeSheffield, GB, S1 4NB1d ago
-
Agentic Systems | Distributed Systems | Language Models | Large Language Models | RubyEmployee stock purchase plan | Equity compensation | Flexible paid time off | Growth and development fund | Parental leaveSenior-level Full TimeRemote, United Kingdom R2d ago
-
Bash | Data Processing | Docker | GCP | Infrastructure as CodeMid-level Full TimeLondon, United Kingdom2d ago
-
Bash | Cloud platform | Data Ingestion | Data Processing | DockerAsynchronous culture | Remote-friendly, distributed teamMid-level Full TimeBrighton, United Kingdom2d ago
-
Senior Software Engineer, Training & Experimentation USD 180K-250KAPI Development | AWS | Asynchronous processing | Automated testing | Azure401k matching | Company holidays | Company winter break | Dental coverage | Flexible scheduleSenior-level Full TimeLondon, England, United Kingdom; New York, … R2d ago
-
Machine Learning Intern GBP 40K-62KComputer Vision | Diffusion Models | Fine Tuning | LLM Fine-tuning | Language ProcessingFlexible start date | Full time or part time | Paid internshipEntry-level InternshipLondon,England,United Kingdom2d ago
-
Staff Software Engineer, Inference GBP 116K-155KAutoscaling | BF16 | Benchmarking | C++ | CUDACritical illness cover | Employee assistance programme | Family dental insurance | Family medical insurance | Life assuranceSenior-level Full TimeLondon, England2d ago
-
Embedded Software Engineer GBP 55K-62KAgile | C++ | Confluence | DO-178C | DOORSCycle and tech scheme | Employee assistance programme | Flexible working | Life insurance | Pension schemeMid-level Full TimeGlasgow, Scotland, United Kingdom2d ago
-
Scientific Data Engineer - Product Safety GBP 70K-74KAWS | Apache Spark | CI/CD | Data Lakehouse | Data ModelingAnnual paid leave | Life insurance | Pension scheme | Private medical insurance | Work-life balanceSenior-level Full TimeBracknell, BERKSHIRE, United Kingdom2d ago
-
Quantitative Developer - Python GBP 40K-50KData cleaning | Financial markets | Machine Learning | Python | Software developmentWork-life balance initiativesMid-level Full TimeLondon2d ago
-
Data Engineer III GBP 80K-90KAWS | Automated testing | CI/CD | CockroachDB | DBTCo-working space access | Company retreat | Equipment stipend | Fully remote | Home office stipendSenior-level Full TimeUnited Kingdom R2d ago
-
Security Analytics Engineer GBP 72K-80KCI/CD | DBT | Data Governance | Data Lineage | Data Modeling25 days holiday per year | Access to cycle garage and showers | Dental scheme | Free soft drinks | Hybrid workingSenior-level Full TimeUnited Kingdom, London R2d ago
-
AI Engineer (Agentic Systems) GBP 78K-109KAgent Orchestration | CI/CD | Cloud APIs | Code review | Guardrails24 7 GP helpline | Continuous L and D | Flexible working environment | Healthcare coverage | Mental health supportMid-level Full TimeBelfast, Northern Ireland, United Kingdom2d ago
-
Production Engineer GBP 74K-100KAPI | C++ | Distributed Systems | Java | Load BalancingOn-call rotationMid-level Full TimeLondon, UK2d ago
-
Product Content Engineer GBP 55K-90KA/B | A/B Testing | AI Evaluation | B testing | Bias MitigationSenior-level Full TimeLondon, UK2d ago
-
APIs | Agent systems | Cloud Security | Cloud platform | CrewAISenior-level Full TimeLondon, UK2d ago
-
Apache Spark | Azure Data | Azure Data Factory | Azure DevOps | Azure Machine LearningEmployer pension matching | Hybrid work | Paid time off | Private medical insuranceSenior-level Full TimeAlderley Edge, GB2d ago
-
AI Inference Tools Engineer USD 167K-242KAgent Frameworks | Benchmarking | C++ | CUDA | Dashboards401k matching | Flexible paid time off | Health insurance | Hybrid work options | Local meetupsSenior-level Full TimeUnited States, United Kingdom R2d ago
-
Senior Applied Scientist GBP 92K-130KCloud | Complex Planning | Data Analysis | Dataset Processing | Deep learningHybrid work option | Learning and development | Remote work flexibility | Stock options | Team meetupsSenior-level Full TimeLondon2d ago
-
Senior AI Solution Engineer GBP 65K-75KAPI Integration | Bias Mitigation | CI/CD | Cloud Computing | ContainerizationBenefits package | Career growth | Hybrid working | Mentorship | Ongoing developmentSenior-level Full TimeWarminster, Wiltshire, United Kingdom R3d ago
-
Senior Machine Learning Engineer (3967) GBP 72K-85KAnomaly Detection | CI/CD | Classification | Clustering | Computer VisionAgile environment | Knowledge sharing | MentorshipSenior-level Full TimeUnited Kingdom - Remote R3d ago
-
Associate Principal Embedded Software Engineer GBP 55K-58KARM | Agile | Analog-to-digital conversion | Assembly | AtlassianAdditional holiday purchase | Dental insurance | Digital GP | Employee assistance program | Fertility treatment supportMid-level Full TimeUnited Kingdom - Malmesbury Office3d ago