Sr. Software Engineer, Inference
Tasks
- Analyze observability data to tune performance
- Build and maintain inference infrastructure
- Build deployment pipelines for model releases
- Design and deploy autoscaling for compute fleet
- Develop distributed systems for large-scale inference
- Enable machine learning research infrastructure
- Implement batching and caching strategies
- Implement intelligent request routing
- Integrate new AI accelerator platforms
- Manage multi-region deployments and geographic routing
- Maximize compute efficiency
- Orchestrate fleet wide inference across accelerators
Perks/Benefits
Skills/Tech-stack
AWS | Batching | Caching | Distributed Systems | GCP | Kubernetes | LLM Inference | Load Balancing | Machine Learning | Python | Request Routing | Rust | Traffic Management
Education
Related jobs
-
Mid-level Full TimeUnited Kingdom8h ago
-
AWS | Apache Spark | Cloud platform | Data Architecture | Data EngineeringCareer development | Travel opportunitiesSenior-level Full TimeLondon, United Kingdom14h ago
-
AI Engineer GBP 100K-125KAPI Development | AWS | Apache Spark | CI/CD | DatabricksCustom designed offices | Enhanced parental leave | Enhanced pension | Free breakfasts and snacks | Life insuranceMid-level Full TimeLondon, England, United Kingdom22h ago
-
Customer AI Developer Specialist GBP 90K-120KAudio Processing | Data Science | Data analytics | Deep learning | ExperimentationCareer development | Counselling | Employee assistance programme | Flexible work policies | Mental wellbeing supportSenior-level Full TimeLondon, 30 Fenchurch Street, United Kingdom22h ago
-
Data and AI Developer GBP 72K-108KAI Governance | AWS | Artificial Intelligence | Cloud Computing | Data EngineeringSenior-level Full TimeNottingham, Eng, United Kingdom22h ago
-
AI Engineer - FDE (Forward Deployed Engineer) GBP 80K-110KAWS | Apache Spark | Azure | Cloud platform | Data EngineeringConference presentations | Remote work | Travel opportunitiesSenior-level Full TimeRemote - United Kingdom R1d ago
-
Systems Research Engineer GBP 74K-121KAI infrastructure | C++ | Data Locality | Distributed Systems | Fault ToleranceNone Full TimeEdinburgh, United Kingdom1d ago
-
Lead Data Engineer GBP 75K-80KAWS | Agile | Apache Spark | Azure | CI/CDAnnual leave | Cycle to work scheme | Discounted gym membership | Employee events and clubs | Employer pension schemeSenior-level Full TimeLeeds1d ago
-
Machine Learning and Quant Engineer - London GBP 110K-200KData Engineering | Financial Modeling | Machine Learning | Python | Scenario AnalysisDirect influence on investment decisions | Equity | In-office work | Technical autonomyMid-level Full TimeLondon1d ago
-
Lead Data Engineer GBP 86K-102KAWS | Apache Airflow | Apache Hive | Apache Spark | AutomationAnnual leave | Flexible benefits | Pension contributions | Private medical insurance | Staff travel benefitsSenior-level Full TimeUnited Kingdom-London-London Luton Airport2d ago
-
Research Engineer, Tool Use, DeepMind GBP 155K-163KAgents | Data Analysis | Data Pipelines | Data Visualization | JAXSenior-level Full TimeLondon, UK2d ago
-
Frontend Engineer, Robotics HMI USD 115K-160KAWS | CI/CD | Datadog | Django | Docker401k match | Cell phone reimbursement | Dental insurance | Employee assistance program | EquityMid-level Full TimeChicago || Bolingbrook, IL R3d ago
-
Senior Specialist Solutions Architect (AI/ML) GBP 74K-110KAWS | Apache Spark | Artificial Intelligence | Azure | Data ScienceSenior-level Full TimeLondon, United Kingdom3d ago
-
AWS Glue | Airflow | Automation | By Design | CI/CDBlended working arrangements | Defined contribution pension | Employee assistance programme | Enhanced maternity leave | Enhanced paternity leaveSenior-level Full TimeLondon, England, United Kingdom3d ago
-
Lead Analytics Engineer GBP 75K-90KAWS | Amazon Web Services | DBT | Omni | SQL3 office days per week in London | Hybrid remote workSenior-level Full TimeLondon3d ago
-
Senior AI Engineer GBP 70K-98KAgentic Workflows | C++ | Evals | Fine Tuning | LLM orchestrationEnhanced parental leave | Enhanced pension scheme | Hybrid working | L and D budget | Private health insuranceSenior-level Full TimeLondon, United Kingdom3d ago
-
Senior Data Engineer GBP 55K-62KAgile | Azure | Azure Data | Azure Data Factory | Azure DatabricksAnnual leave | Flexible benefits | Income protection | Pension | Private medical insuranceSenior-level Full TimeLeeds, United Kingdom R3d ago
-
Machine Learning Engineer GBP 80K-110KAWS | Azure | Best practices | Cloud infrastructure | Cloud platformCoaching | Enhanced parental leave | Flexible working | Hybrid working | Private dentalMid-level Full TimeUK - London3d ago
-
Alerting | Anomaly Detection | Automated testing | CI/CD | Change ManagementSenior-level Full TimeLondon3d ago
-
Forward Deployed Engineer, Applied AI, Google Cloud GBP 97K-140KAPIs | Agent systems | Cloud platform | Conversational AI | Evaluation PipelinesTravel up to 50 percentSenior-level Full TimeLondon, UK; Zürich, Switzerland3d ago
-
Staff Software Engineer, Generative AI Blackbelt Team GBP 180K-225KArtificial Intelligence | Cloud Computing | Distributed Systems | Generative AI | Information RetrievalSenior-level Full TimeLondon, UK3d ago
-
Applied Scientist - Forecasting GBP 50K-60KCausal Inference | Data Processing | Deep learning | Distributed data | Distributed data processingEmployee discount | Employee sample sales | Paid annual leave | Personalised learning | Private medical careMid-level Full TimeLondon, England, United Kingdom3d ago
-
Member of Technical Staff - Applied AI Lead, Health GBP 93K-161KAgentic Systems | Benchmarking | Context engineering | Data Pipelines | Dataset curationSenior-level Full TimeLondon, England, GB3d ago
-
Applied AI Engineer (UK) GBP 35K-50KAutomation | CRM | Compliance | Evaluation | Fraud DetectionEnglish communication | Hybrid work | Work from UK office at least 3 days per weekMid-level Full TimeUnited Kingdom3d ago
-
Junior Data Platform Engineer GBP 30K-35KAWS | Azure | CI/CD | GitHub | InformaticaComprehensive benefits package | Development support | Flexible working | Wellbeing supportEntry-level Full TimeKingswood Fields Office, United Kingdom3d ago