Staff Software Engineer, Inference
Tasks
- Build and operate Kubernetes native inference platform
- Drive cross cutting architecture initiatives
- Establish performance benchmarking frameworks
- Implement inference optimizations
- Improve tail latency and platform reliability
- Increase observability
- Manage GPU resources
- Mentor engineers and raise engineering rigor
- Optimize request routing and adaptive scheduling
- Own SLIs and SLOs
- Perform capacity planning and autoscaling
Perks/Benefits
- 401k matching
- Casual work environment
- Catered meals
- Childcare support
- Commuter benefits
- Dental insurance
- Disability insurance
- Employee stock purchase program
- Flexible PTO
- Flexible spending account
- Health insurance
- Health savings account
- Life insurance
- Paid parental leave
- Tuition reimbursement
- Vision insurance
Skills/Tech-stack
Autoscaling | BF16 | Batching | Benchmarking | C++ | CUDA | CUDA memory optimization | Caching | Capacity Planning | Distributed Systems | FP8 | GPU Interconnect | GPU resource management | GPU systems | GPU systems engineering | Go | KV cache | Kubernetes | Kv cache reuse | Memory Optimization | Metrics-driven | Metrics-driven engineering | Micro Batching | Mixed Precision | NCCL | NUMA | Networked systems | Observability | P99 SLA | Performance optimization | Python | RDMA | Request Routing | Resource Management | SLI | SLO | Scheduling | Speculative decoding | Streaming | Systems engineering
Education
Roles
Related jobs
-
Data Science & AI Specialist GBP 28K-28KAWS | Advanced Analytics | Artificial Intelligence | Cloud platform | Data PipelinesDiscounted products | Gym membership | Holiday purchase scheme | Paid carer’s leave | Pension schemeMid-level Full TimeIpswich, GB, IP5 3RE4h ago
-
Senior Data Engineer - Data Science Platform GBP 60K-70KApache Spark | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageDiscretionary bonus scheme | Employee discount | Employee sample sales | Flexible benefits allowance | Paid annual leaveSenior-level Full TimeLondon, England, United Kingdom5h ago
-
Data Engineer - Core Engineering GBP 58K-71KAzure Data | Azure Data Factory | Azure DevOps | CI/CD | Data FactoryAnnual leave | Bank holidays | Employer pension matching | Hybrid work | Private medical insuranceEntry-level Full TimeEdinburgh, GB5h ago
-
AI Engineer, Enablement (London) GBP 110K-150KAWS | Agent architecture | Azure | Docker | Evaluation401k plan | Dental insurance | Flexible vacation | Meals on in office days | Medical insuranceMid-level Full TimeLondon14h ago
-
AI Research Engineer USD 200K-400KAgent systems | Constrained decoding | Data Curation | Evaluation Harness | Hugging FaceMid-level Full TimeNew York City15h ago
-
C++ Algorithms Engineer GBP 50K-61KC++ | CI/CD | Configuration Management | Containerization | GPU integrationCycle and tech scheme | Employee assistance programme | Flexible working | Life insurance | Pension schemeSenior-level Full TimeManchester, England, United Kingdom17h ago
-
Embedded Software Engineer GBP 45K-60KAUTOSAR | Agile | C# | C++ | Embedded SystemsCycle and tech scheme | Employee assistance programme | Flexible working | Life insurance | Pension schemeMid-level Full TimeManchester, England, United Kingdom17h ago
-
Embedded Software Lead GBP 61K-65KC++ | Code review | Data Processing | Debugging | Embedded LinuxCareer development | Cycle & Tech Scheme | Employee assistance programme | Flexible working | Life insuranceSenior-level Full TimePortsmouth, England, United Kingdom17h ago
-
Embedded Software Engineer GBP 56K-61KAgile | C# | C++ | Debugging | GitCycle & Tech Scheme | Employee assistance programme | Flexible working | Life insurance | Pension schemeMid-level Full TimePlymouth, England, United Kingdom18h ago
-
Senior ML Engineer (AI Research/ Portability) GBP 190K-230KAPI Design | Agent systems | Authentication | CI/CD | Code reviewCareer growth | Collaborative culture | Flexibility | International environment | Learning opportunitiesSenior-level Full TimeAmsterdam, Netherlands; Remote - Europe; United … R19h ago
-
Senior ML Engineer (AI Research, Physical AI) GBP 92K-173KComputer Vision | Control | Deep learning | Distributed Computing | Distributed TrainingCareer growth and learning opportunities | Collaborative culture | Flexibility | International environment | OwnershipSenior-level Full TimeAmsterdam, Netherlands; Remote - Europe; United … R19h ago
-
Senior Data Engineer I - Scalable Growth GBP 85K-115KAirflow | Batch pipelines | Big Data | Braze | Braze APISenior-level Full TimeLondon, United Kingdom22h ago
-
Backup and Recovery | C++ | Capacity Management | Compaction | DebuggingMentorship | On-call rotation | Open Source contributionSenior-level Full TimeLondon23h ago
-
Embedded Security Expert GBP 56K-61KAES | ARM architecture | Bootloader | C# | C++Bonus | Flexible working hours | Paid time off | Pension planSenior-level Full TimeHebburn - South Tyneside - United …23h ago
-
Solution Engineer - Insurance & Asset Management GBP 75K-95KData Engineering | Data Governance | Data Lakes | Data Modeling | Data WarehousingSenior-level Full TimeGB-London1d ago
-
Solution Engineer - FSI GBP 71K-95KCloud Computing | Data Engineering | Data Governance | Data Lakes | Data ModelingSenior-level Full TimeGB-London1d ago
-
Senior Embedded Software Engineer GBP 60K-70KARM Cortex | ARM Cortex-M | Bash | C# | CANEducation assistance program | Employee assistance program | Employee referral program | Employee stock purchase program | Family leaveSenior-level Full TimeGlasgow, Scotland, United Kingdom1d ago
-
Applied AI Engineer EUR 90K-92KAgent systems | Agent workflows | Agent/tool use | Alerting | Chain-of-ThoughtSenior-level Full TimeLondon, UK; Madrid, Spain1d ago
-
Senior Software Engineer, GenAI Platform GBP 75K-90KAPIs | AWS | Autoscaling | Batch inference | Cost OptimizationSenior-level Full TimeLondon - The River Building HQ1d ago
-
CI/CD | Data Pipelines | FastAPI | Flask | GitDiscounts | Electric car scheme | Family leave | Generous pension contribution | Healthcare planEntry-level Full TimeLondon, England, United Kingdom1d ago
-
Senior Lead Software Engineer - CDAO Data Platforms GBP 84K-109KAI Assisted Development | Cause analysis | Cloud Native | Code review | Distributed SystemsSenior-level Full TimeLONDON, United Kingdom1d ago
-
Senior Data Engineer II - Scalable Growth GBP 111K-145KApache Airflow | Apache Kafka | Braze | DBT | Data Pipeline MonitoringMid-level Full TimeLondon, United Kingdom1d ago
-
Asynchronous programming | Automated testing | Cats Effect | Cause analysis | Cloud NativeSenior-level Full TimeLONDON, United Kingdom1d ago
-
AI Assisted Development | Agile methodologies | Application Resiliency | Asynchronous programming | Automated testingSenior-level Full TimeLONDON, United Kingdom1d ago
-
Data Analysis | Data Pipelines | Data Processing | Debugging | Distributed SystemsAgile work environment | Healthcare benefits | Paid time offSenior-level Full TimeUnited Kingdom, Cambridgeshire, Cambridge1d ago