Staff Software Engineer, Inference
Tasks
- Analyze observability data for performance tuning
- Build deployment pipelines for model releases
- Build fleet orchestration across accelerators
- Contribute to inference features
- Design intelligent routing algorithms
- Develop large scale service orchestration
- Identify infrastructure blockers
- Implement autoscaling for compute fleet
- Implement distributed request routing
- Integrate AI accelerator platforms
- Manage multi-region deployments and geographic routing
- Optimize distributed inference performance
Perks/Benefits
Skills/Tech-stack
AWS | Batching | Caching | Distributed Systems | GCP | Inference Optimization | Kubernetes | LLM Inference | LLM Inference Optimization | Learning systems | Load Balancing | Machine Learning | Machine learning systems | Performance optimization | Python | Request Routing | Rust | Service orchestration | Traffic Management
Education
Roles
Related jobs
-
AI Engineer - Nexus Black GBP 78K-115KAPIs | CI/CD | Cloud Computing | Embeddings | EvaluationHybrid workSenior-level Full TimeLondon, England, United Kingdom9h ago
-
Senior Data Engineer GBP 64K-90KAWS | CI/CD | DBT | Data Governance | Data Quality30 days annual leave | Cycle to work scheme | Dog-friendly | Electric car scheme | Enhanced family leaveSenior-level Full TimeTring, United Kingdom R11h ago
-
AWS | Alertmanager | Amazon EKS | Amazon SageMaker | AutoscalingSenior-level Full TimeGLASGOW, LANARKSHIRE, United Kingdom11h ago
-
Senior Quant/AI Developer, Global Markets GBP 84K-115KAgentic design | Artificial Intelligence | Data Engineering | Machine Learning | NumPyCareer comeback program | Flexible working optionsSenior-level Full TimeLondon, United Kingdom21h ago
-
Principal AI Engineer GBP 90K-120KAccuracy Optimization | Artificial Intelligence | Audit Logging | Code review | ComplianceSenior-level Full TimeKnutsford, Radbroke Hall, United Kingdom21h ago
-
Data Engineer II GBP 39K-46KAWS | Apache Airflow | Apache Spark | CI/CD | Data LakesComprehensive pension plan | Employee assistance program | Employee discounts | Flexible working hours | Generous vacationMid-level Full TimeUK - London (London Wall), United …21h ago
-
Senior-level Full TimeCanary Wharf, 1 Churchill Place, United …21h ago
-
AWS | Apache Spark | Cloud platform | Data Engineering | Data WarehousingSenior-level Full TimeLondon, United Kingdom1d ago
-
Applied AI Engineer - Finance Super App (UK) GBP 35K-50KAPIs | Agents | Data integration | Evaluation | LLM APIsHealth insurance | Hybrid work | Professional development opportunitiesMid-level Full TimeUnited Kingdom1d ago
-
Senior AI Software Engineer GBP 69K-108KC# | C++ | CUDA | Compilers | Deep learningAdditional time off for learning and development | Annual leave | Company sports club | Cycle to work scheme | Employee assistance programSenior-level Full TimeCambridge, United Kingdom1d ago
-
Senior-level Contract Full TimeLondon, England, United Kingdom1d ago
-
Senior AI Engineer GBP 78K-100KAWS | Anomaly Detection | Computer Vision | Data Modeling | Decision TreesAI experimentation budget | Equity | Group life assurance | Hybrid working | Income protectionSenior-level Full TimeLondon1d ago
-
Staff Applied Scientist GBP 110K-160KBlack | Cloud Computing | Complex Planning | Deep learning | Explainable AIFlexible remote work | Generous share options | Hybrid work options | Mentoring and coaching culture | Tax efficient EMI share option schemeSenior-level Full TimeLondon1d ago
-
Senior Applied Scientist GBP 100K-120KBlack | Cloud Computing | Complex Planning | Data Analysis | Deep learningHybrid work | Mentoring and coaching | Share optionsSenior-level Full TimeLondon1d ago
-
Senior Machine Learning Software Engineer GBP 56K-70K3D Imaging | 4D Imaging | Azure DevOps | C++ | CPU OptimizationAccredited Learning and Development Programmes | Bereavement leave | Company sick pay | Cycle to work scheme | Early finish every FridaySenior-level Full TimeBelfast, GB1d ago
-
APIs | Agent systems | Cloud platform | CrewAI | EvaluationAccess to advanced AI models | Customer-facing work | White glove deploymentMid-level Full TimeLondon, UK2d ago
-
API Integration | Agent systems | Cloud platform | Cost Optimization | CrewAISenior-level Full TimeLondon, UK2d ago
-
APIs | Agent systems | Artificial Intelligence | Cloud platform | CrewAISenior-level Full TimeLondon, UK2d ago
-
AI Architect, Partner Engineering GBP 100K-120KAgent systems | AlloyDB AI | BigQuery | BigQuery Zero Copy | C++Senior-level Full TimeLondon, UK; Zürich, Switzerland2d ago
-
Bash | Cloud platform | Data Processing | Docker | Google CloudAsynchronous work culture | Flexible management approach | Remote-friendly, distributed teamMid-level Full TimeEdinburgh, United Kingdom2d ago
-
Bash | Cloud platform | Data Ingestion | Data Processing | DockerAsynchronous culture | Diverse and inclusive workplace | Impactful mission | Laid-back atmosphereMid-level Full TimeBirmingham, United Kingdom2d ago
-
Bash | Cloud platform | Data Processing | Docker | Google CloudAsynchronous culture | Career impact | Flexible work environment | Remote-friendly environmentMid-level Full TimeNottingham, United Kingdom2d ago
-
Bash | Cloud platform | Data Ingestion | Data Processing | DockerAsynchronous work culture | Flexible management style | Remote-friendly setupMid-level Full TimeGlasgow, United Kingdom2d ago
-
Software Engineer (Inference Platform), London GBP 130K-186KCI/CD | Cloud platform | Distributed Systems | GPU | Google CloudHybrid workExecutive-level Full TimeLondon R3d ago
-
Senior Machine Learning Engineer GBP 70K-85KAutomated testing | CI/CD | Containerization | Deep learning | Distributed TrainingEmployee discount | Employee sample sales | Flexible benefits allowance | Paid annual leave | Personalised learningSenior-level Full TimeLondon, England, United Kingdom3d ago