Senior Software Engineer, Inference Platform
London, England, United Kingdom
GBP 225K-325K (estimate) Senior-level Full Time
Tasks
- Architect inference platform components
- Build deployment pipelines
- Build observability telemetry stack
- Conduct code reviews
- Debug production distributed systems
- Design inference service platform
- Implement low latency high throughput inference
- Implement model routing and canary deployments
- Implement monitoring and alerting
- Improve testing and documentation
- Optimize GPU utilization and cold start
- Optimize inference pipelines for batching and throughput
Perks/Benefits
Skills/Tech-stack
API Gateway | Authentication | Authorization | Autoscaling | Batching | C++ | Distributed Systems | Distributed tracing | Docker | Event Driven | Event-driven architecture | GPU Computing | Golang | Grafana | High Throughput | Infrastructure as Code | Kafka | Kubernetes | Latency optimization | Load Balancing | Low Latency | Microservices | Multi-tenancy | OpenTelemetry | PostgreSQL | Prometheus | Python | Quantization | RabbitMQ | Rate Limiting | Redis | Resource scheduling | Rust | TensorRT | TensorRT-LLM | Text Generation | Text generation inference | VLLM | “as-code”
Education
N/A
Related jobs
-
Staff Applied Scientist GBP 165K-190KCloud Computing | Complex Planning | Data Analysis | Deep learning | Explainable AIHybrid work | Mentoring and coaching | Share optionsSenior-level Full TimeLondon1d ago
-
Senior Applied Scientist GBP 100K-120KBlack | Cloud Computing | Code Quality | Complex Planning | Data AnalysisFlexible schedule | Hybrid work | Remote work | Share options | Slack communicationSenior-level Full TimeLondon1d ago
-
Lead AI Engineer GBP 75K-90KAWS | Agent Orchestration | Agent systems | Azure | EvaluationCycle to work scheme | Dental insurance | Happy hours | Health insurance | Learning and development budgetSenior-level Full TimeLondon, England, United Kingdom1d ago
-
Senior Software Engineer, Inference GBP 120K-145KAPI Development | Backend Development | Development kits | Inference infrastructure | Latency optimizationSenior-level Full TimeUnited Kingdom2d ago
-
Senior Data Analytics Engineer GBP 85K-95KAggregate Functions | BigQuery | CI | CTE | DBTRemote-flexible work | Team in person London every 6 to 8 weeksSenior-level Full TimeLondon, United Kingdom R2d ago
-
Commodity Trading Analytics Internship Program GBP 50K-60KData Analysis | Data Visualization | Excel | Financial Modeling | ForecastingCohort based learning | Mentorship | On-site internshipEntry-level InternshipLondon, United Kingdom2d ago
-
DVP Data Engineer GBP 45K-55KAccelerometer | Automotive Engineering | Data Analysis | Data Visualization | Data acquisitionCareer development opportunities | Company events | Company pension | Free refreshments | On-site parkingMid-level Full TimeDaventry, England, GB2d ago
-
Senior Software Engineer - AI Solutions GBP 58K-85KDeveloper experience | Django | LLM | Python | Retrieval-Augmented GenerationFlexible work environment | Interview accommodations | Mentorship culture | Relocation supportSenior-level Full TimeLondon (GB)2d ago
-
Data Engineering | Dataset curation | Evaluation | Experimentation | Language ModelsSenior-level Full TimeUnited Kingdom, London, London2d ago
-
Senior Machine Learning Engineer GBP 28K-30KAlerting | Algorithms | Apache Spark | BigQuery | Cloud ComputingAnnual bonus scheme | Bank holidays | Employee assistance programme | Free 247 virtual GP service | Holiday Starting At 25 DaysSenior-level Full TimeWelwyn Garden City, United Kingdom of …2d ago
-
Applied AI ML Data Scientist, Vice President - Payments GBP 100K-186KAPIs | AWS | Agent systems | Audit documentation | Automated testingExecutive-level Full TimeLONDON, United Kingdom2d ago
-
Senior Data Science Lead - AML Risk GBP 75K-115KData Pipelines | Data labeling | Experiment design | GenAI | Machine LearningSenior-level Full TimeLondon, United Kingdom2d ago
-
Senior Embedded Software Engineer GBP 60K-65KAgile | C# | C++ | CAN | CI/CDCareer growth | Health and wellbeing support | Inclusive workplace | On-site flexibility | Training opportunitiesSenior-level Full TimeHemel Hempstead, England, United Kingdom2d ago
-
Senior Embedded Software Engineer (All Genders) GBP 45K-68KC# | C++ | CAN | CMake | DTSInclusive supportive environment for Armed Forces community | UK Security clearance supportSenior-level Full TimeSwindon2d ago
-
Research Engineer - Data Infrastructure GBP 100K-180KData Augmentation | Data Curation | Data Deduplication | Data Pipelines | Data QualityAnnual company offsite | Learning and development stipend | Monthly co-working stipend | Social travel stipendMid-level Full TimeUnited Kingdom R2d ago
-
AWS | Airflow | Application design | Automated testing | CI/CDExecutive-level Full TimeLONDON, United Kingdom2d ago
-
Research Engineer - Inference GBP 150K-300KBatching | CUDA | Inference Optimization | KV cache | Knowledge DistillationAnnual company offsite | Co-working stipend | Learning and development stipend | Remote work | Social travel stipendMid-level Full TimeUnited Kingdom R2d ago
-
Data Platform Engineer, London GBP 71K-73KBioinformatics | Cloud platform | Computational Chemistry | DBT | Data EngineeringHybrid workMid-level Full TimeLondon2d ago
-
Embedded Electronics & Firmware Engineer GBP 45K-50KATEX | Altium | Analog design | C# | C++Additional birthday leave | Cash plan | Death in service | Employee assistance programme | Flexible work hoursMid-level Full TimeWitney, United Kingdom3d ago
-
Data Engineer GBP 50K-70KAmazon Web Services | Apache Flink | Apache Kafka | Apache Spark | AzureIn office collaboration 4 days per week | Opportunity to work on cutting-edge technology | Remote work flexibility | Team of talented engineers | Work-life flexibilityMid-level Full TimeLondon R3d ago
-
C# | C++ | Distributed Systems | Experimentation | GoAccident insurance | Commuter benefits | Dental insurance | Disability insurance | Financial wellness supportSenior-level Full TimeCambridge, United Kingdom R3d ago
-
Bash | Cloud platform | Data Processing | Docker | Google CloudMid-level Full TimeManchester, United Kingdom3d ago
-
Bash | Cloud platform | Data Ingestion | Data Processing | DockerMid-level Full TimeNewcastle, United Kingdom3d ago
-
Azure Databricks Developer EUR 56KAgile | Apache Spark | Azure Data | Azure Data Factory | Azure Data LakeFlex benefits program | Income protection | Life assurance | Paid time off | Pension matchingMid-level Full TimeUK Wide, GB R3d ago
-
Entry-level ContractLeeds, England, United Kingdom3d ago