Staff Software Engineer, Inference
Tasks
- Analyze observability data for performance tuning
- Build deployment pipelines for model releases
- Build fleet orchestration across accelerators
- Contribute to inference features
- Design intelligent routing algorithms
- Develop large scale service orchestration
- Identify infrastructure blockers
- Implement autoscaling for compute fleet
- Implement distributed request routing
- Integrate AI accelerator platforms
- Manage multi-region deployments and geographic routing
- Optimize distributed inference performance
Perks/Benefits
Skills/Tech-stack
AWS | Batching | Caching | Distributed Systems | GCP | Inference Optimization | Kubernetes | LLM Inference | LLM Inference Optimization | Learning systems | Load Balancing | Machine Learning | Machine learning systems | Performance optimization | Python | Request Routing | Rust | Service orchestration | Traffic Management
Education
Roles
Related jobs
-
AI Engineer USD 100K-250KBackend Development | Context Management | Evaluation Pipeline | Postgres | Prompt engineeringEquity | Free meals | Private medical insurance | Visa sponsorshipEntry-level Full TimeLondon1d ago
-
Agile | C# | C++ | Computer Vision | Data StructuresDiversity and inclusion | Innovation-driven culture | International company | Learning opportunities | Professional growthMid-level Full TimeGBR, London, United Kingdom1d ago
-
AWS CDK | AWS Glue | AWS Lambda | Agile | Amazon KinesisGlobal experience | Immigration supportMid-level Full TimeLondon, United Kingdom1d ago
-
C++ | Data Mining | Distributed Computing | Generative AI | High PerformanceGlobal experience | Immigration supportMid-level Full TimeLondon, United Kingdom1d ago
-
Research Engineer, Safety Oversight, DeepMind GBP 100K-180KAutomated Evaluation | Classifier Models | Data Pipelines | Data Quality | ExperimentationMid-level Full TimeLondon, UK1d ago
-
Data Engineer GBP 46K-52KAzure | Azure Databricks | CI/CD | PythonBonus scheme | Discounts and perks | Employee assistance programme | Generous holiday entitlement | Hybrid workingMid-level Full TimeSentinel Building, Glasgow, United Kingdom1d ago
-
Sr. Specialist Solutions Architect GBP 78K-120KAI Observability | AWS | Agent Orchestration | Agentic Systems | Apache SparkSenior-level Full TimeLondon, United Kingdom1d ago
-
C++ Software Engineer - Data Platform GBP 60K-74KAlgorithms | C++ | Columnar Storage | Compute Engines | ConcurrencyMid-level Full TimeLondon2d ago
-
Data Analyst, Product GBP 95K-124KA/B | A/B Testing | Analytical Functions | Apache Airflow | B testingSenior-level Full TimeUnited Kingdom2d ago
-
Machine Learning Engineer GBP 55K-55KAzure Machine Learning | Clustering | Data Monitoring | Decision Trees | DevOpsHybrid working | Opportunities for coaching and mentoringMid-level Full TimeManchester, Greater Manchester, United Kingdom2d ago
-
Bash | Data Processing | Docker | GCP | Infrastructure as CodeAsynchronous culture | Flexible management | Remote workMid-level Full TimeLondon, United Kingdom2d ago
-
Blameless postmortems | C++ | Distributed Systems | Fault Tolerance | JavaSenior-level Full TimeLondon2d ago
-
Applied statistics | Artificial Intelligence | Digital Signal | Digital Signal Processing | Edge ComputingHybrid workingSenior-level Full TimeUnited Kingdom2d ago
-
Intermediate Data Engineer GBP 40K-45KAWS | AWS RDS | Branching | CI/CD | CloudFormationAnnual hackathon events | Cycle to work scheme | Electric vehicle scheme | Flexible working | Health and wellbeing programmeMid-level Full TimeNorth West UK - Hybrid R2d ago
-
Data Engineer - AI/ML (f/m/d) GBP 50K-60KAWS | Agile | Azure | Azure Data | Azure Data FactoryFlexi-Week | Health and wellbeing support | Hybrid remote working | Peer to peer recognition voucher | Remote Working FurnitureMid-level Full TimeBerlin, Berlin, Germany; Iași, Iași, Romania; …2d ago
-
Annotation | Computer Vision | Computer Vision Pipelines | Data Preprocessing | GDPRBirthday off | Company celebrations | Equity plan | Flexible working hours | Global team outingsSenior-level Full TimeUnited Kingdom2d ago
-
AI Business Enablement - Senior Associate GBP 90K-126KAPI Integration | Agent Orchestration | Embeddings | Function Calling | Language ModelsSenior-level Full TimeLONDON, LONDON, United Kingdom2d ago
-
Mid-level Full TimeLondon, UK2d ago
-
Bash | Cloud platform | Data Processing | Docker | GCPAsynchronous culture | Friendly work environment | Remote friendly settingMid-level Full TimeBristol, United Kingdom2d ago
-
Bash | Cloud platform | Data Processing | Docker | Google CloudAsynchronous culture | Friendly work environment | Impactful product | Professional growthMid-level Full TimeLeeds, United Kingdom2d ago
-
Mid-level Full TimeYork, United Kingdom2d ago
-
Quantitative Analyst GBP 84K-119KAgents | Artificial Intelligence | Financial markets | Language Models | Language ProcessingMid-level Full TimeLondon, United Kingdom2d ago
-
Junior Data Engineer GBP 35K-35KAWS | Access Control | Airflow | Apache Iceberg | Apache SparkChildcare vouchers | Corporate gym memberships | Cycle to work scheme | Electric car lease programme | Health assessmentsEntry-level Full TimeLondon, United Kingdom2d ago
-
Data Scientist (Gen AI) GBP 72K-109KAI monitoring | Data Querying | Generative AI | Guardrails | Information RetrievalDental insurance | Digital GP | Discounts on products | Free or discounted TV package | Gym accessSenior-level Full TimeOsterley, United Kingdom2d ago
-
SW Engineer III - Data Analytics & Insights GBP 48K-48KAgile | Azure | Azure Data | Azure Data Factory | Azure SynapseContinuous improvement culture | Hybrid work environment | Mentorship opportunitiesSenior-level Full TimeDundee (Discovery) Office, United Kingdom2d ago