Staff Software Engineer, Inference
Tasks
- Analyze observability data for performance tuning
- Build request routing load balancing traffic management
- Create deployment pipelines for releasing models
- Design distributed systems to serve AI models
- Develop resilient real time adaptive systems
- Implement fleet autoscaling and orchestration
- Integrate AI accelerator platforms for new model architectures
- Manage multi-region deployments and geographic routing
- Provide high performance inference infrastructure
Perks/Benefits
- Competitive benefits
- Equity donation matching
- Flexible working hours
- Generous vacation
- Hybrid work policy
- Parental leave
- Visa sponsorship support
Skills/Tech-stack
AWS | Autoscaling | Azure | Batching | Caching | Containerization | Distributed Systems | GCP | Kubernetes | LLM Inference | Learning systems | Load Balancing | Machine Learning | Machine learning systems | Observability | Orchestration | Python | Request Routing | Rust | Traffic Management
Education
Roles
Related jobs
-
Mid-level Full TimeLeeds/Sheffield/Manchester, UK (Hybrid) R12h ago
-
Senior AI Engineer GBP 50K-60KArize | Braintrust | CI/CD | Cost attribution | Golden datasetsEnhanced parental and adoption leave | Financial coaching | Flexible working | Hybrid or remote work | Paid learning and developmentSenior-level Full TimeLeeds, Manchester, Edinburgh, London17h ago
-
Data Platform Engineer GBP 76K-100KAWS EC2 | AWS Glue | AWS IAM | AWS Secrets | AWS Secrets ManagerCertification study budget | Course and conference budget | Funded certification paths | Hybrid/Remote flexibility | On-call rotationSenior-level Full TimeAshford, England, United Kingdom; Bengaluru, Karnataka, …18h ago
-
Data Engineer III GBP 80K-90KAWS | Automated testing | CI/CD | CockroachDB | ContainerizationCo-working space access | Company retreat | Competitive share options | Fully remote | Home office setup stipendSenior-level Full TimeUnited Kingdom R18h ago
-
Ansible | Apache | Azure Data | Azure Data Factory | Azure Data LakeFlexible contract work | Hybrid work | On-site collaborationMid-level Contract Full TimeSheffield, England, United Kingdom19h ago
-
Cloud / Infrastructure Engineer GBP 50K-70KAmazon EKS | Amazon Web Services | CI/CD | Docker | GitLab CIMid-level Full TimeWhiteley19h ago
-
Senior Machine Learning Engineer, AI Performance GBP 150K-162KCUDA | Deep learning | Knowledge Distillation | Machine Learning | Model OptimizationSenior-level Full TimeLondon20h ago
-
Senior Analytics Engineer GBP 85K-105KAzure | CI/CD | DBT | Data Governance | Data QualityEnhanced parental leave | Fertility support | Flexible working | Free meals and snacks | Healthcare coverageSenior-level Full TimeLondon (Shoreditch) R21h ago
-
Senior Data Engineer GBP 75K-88KAPI Integration | Agile | Cloud Storage | DBT | Data GovernanceDental insurance | Employee discounts | Hybrid work | Medical insurance | Mental health daysSenior-level Full TimeLondon, United Kingdom21h ago
-
Senior Analytics Engineer - Cyber Data Platform GBP 43K-54KApache Airflow | Azure | CI/CD | DBT | Data GovernanceAnnual bonus scheme | Bank holidays | Employee assistance programme | Flexible working | Free virtual GP serviceSenior-level Full TimeWelwyn Garden City, United Kingdom of …21h ago
-
APIs | C++ | Cloud Computing | Docker | GoEntry-level Full TimeLondon, UK23h ago
-
Staff Software Engineer, Labs Science GBP 90K-119KAI prompts | API Development | Agentic coding | C++ | Cloud platformSenior-level Full TimeLondon, UK23h ago
-
API Design | AWS | Apache Airflow | Apache Iceberg | Apache KafkaSenior-level Full TimeGLASGOW, LANARKSHIRE, United Kingdom1d ago
-
Data Engineer GBP 52K-75KAWS | Apache Flink | Apache Spark | Azure | Cloud platformOn site collaboration time | Remote work one day per weekMid-level Full TimeLondon R1d ago
-
Lead ML Engineer GBP 70K-85KAWS SageMaker | AWS Step Functions | Apache Airflow | CD pipelines | CI/CDHybrid workSenior-level Full TimeLondon, United Kingdom1d ago
-
Senior Data Engineer GBP 60K-65KApache Cassandra | Apache Spark | Azure Blob | Azure Blob Storage | Azure DataFlexible working hours | Paid parental leave | Remote work possibility | Training and development programsSenior-level Full TimeLondon - Shell Centre, United Kingdom1d ago
-
Senior Engineer - Data Science GBP 72K-80KAPI Versioning | API documentation | Authentication | Autogen | Automated testingCoaching and development opportunities | Comprehensive total rewards programme | Flexible benefits | World class training programmeSenior-level Full Time100 BISHOPSGATE:LONDON, United Kingdom1d ago
-
Data Engineer GBP 64K-70KAccess Control | Alerting | Batch Processing | Cause analysis | ComplianceSenior-level Full TimeLeeds, United Kingdom1d ago
-
GenAI Full-Stack Engineer Lead GBP 78K-109KAPI Design | Continuous Improvement | DevSecOps | Distributed Systems | DockerAnnual leave | Employee assistance program | Hybrid work model | Life insurance | Paid parental leaveSenior-level Full TimeLocation(s): Belfast, Northern Ireland, United Kingdom1d ago
-
Senior-level Full TimeUK - Horsham - Langhurstwood Rd … R1d ago
-
Senior Machine Learning Engineer GBP 70K-85KAWS Bedrock | Amazon SageMaker | Azure | CI/CD | Cloud platformAdditional annual leave purchase | Birthday holiday | Global environment | Hybrid working | Life assuranceSenior-level Full TimeLondon, GB, W4 5YE1d ago
-
AI Engineer, Retrieval & Agentic Systems GBP 90K-105KAgentic Systems | BM25 | Information Retrieval | Knowledge graph | PythonHybrid work | Paid time off | Pension plan | Private health insuranceMid-level Full TimeLondon1d ago
-
Senior AI Engineer, Agentic Systems GBP 105K-120KAPI Design | AWS | Agent systems | Agentic Systems | BM25Annual leave | Hybrid work | Pension plan | Private health insuranceSenior-level Full TimeLondon1d ago
-
Fullstack Machine Learning Developer (Junie) GBP 100K-131KAgent workflows | Command Line | Command-line Interface | Cost Optimization | Language ModelsExtra time off | Gym or Sports Stipend | Language classes | Learning and development | Lunch allowanceMid-level Full TimeAmsterdam, Netherlands; Belgrade, Serbia; Berlin, Germany; … R1d ago
-
Associate AI Engineer GBP 57K-63KAmazon Web Services | Artificial Intelligence | CI/CD | Docker | EmbeddingsEmployee assistance program | Employee share purchase plan | Hybrid working | Learning and development | Life assuranceMid-level Full TimeLondon, United Kingdom1d ago