Staff Software Engineer, Inference
Tasks
- Analyze observability data for performance tuning
- Build request routing load balancing traffic management
- Create deployment pipelines for releasing models
- Design distributed systems to serve AI models
- Develop resilient real time adaptive systems
- Implement fleet autoscaling and orchestration
- Integrate AI accelerator platforms for new model architectures
- Manage multi-region deployments and geographic routing
- Provide high performance inference infrastructure
Perks/Benefits
- Competitive benefits
- Equity donation matching
- Flexible working hours
- Generous vacation
- Hybrid work policy
- Parental leave
- Visa sponsorship support
Skills/Tech-stack
AWS | Autoscaling | Azure | Batching | Caching | Containerization | Distributed Systems | GCP | Kubernetes | LLM Inference | Learning systems | Load Balancing | Machine Learning | Machine learning systems | Observability | Orchestration | Python | Request Routing | Rust | Traffic Management
Education
Roles
Related jobs
-
Algorithms | Analytics Pipelines | C++ | Code review | Data StructuresSenior-level Full TimeLondon, UK8h ago
-
Research Engineer, AGI Safety and Alignment, DeepMind GBP 150K-220KAdversarial Training | Artificial Intelligence | Evaluation | Fine Tuning | Human FeedbackMid-level Full TimeLondon, UK8h ago
-
Lead Data Platform Engineer -6 Month Secondment GBP 85K-102KAPI Integration | AWS Glue | AWS Lake | AWS Lake Formation | AWS LambdaAnnual leave | Bank holidays | Healthcare | Pension | SharesaveSenior-level Full TimeNottingham, United Kingdom R12h ago
-
Machine Learning Systems Engineer, Ads ML Platform GBP 90K-110KAnomaly Detection | Apache Airflow | Apache Flink | Apache Kafka | Apache SparkBike to work scheme | Family planning support | Flexible vacation | Gender-affirming care | Group personal pension scheme with employer matchMid-level Full TimeRemote - United Kingdom R19h ago
-
Senior Field Specialist - Data Platform GBP 65K-89KAnsible Automation | Apache Airflow | Apache Impala | Apache Ozone | Apache SparkContinued Career Development | Employee resource groups | Flexible WFH | Generous PTO | Mental and physical wellness programsSenior-level Full TimeUK-Remote, United Kingdom R19h ago
-
Member of Technical Staff, Data Flywheel USD 135K-260KData Curation | Data Pipelines | Data Quality | Data Quality Validation | Data VersioningAnnual wellness allowance | Dental insurance | Happy hours | Health insurance | Life insuranceSenior-level Full TimeNew York, NY22h ago
-
Senior Data Engineer GBP 95K-115KAWS Databricks | AWS Glue | Apache Airflow | Apache Kafka | Data ModelingAnnual leave | Bank holidays | Pension plan | Private health insuranceSenior-level Full TimeLondon R23h ago
-
Applied AI Architect, Digital Natives Business GBP 190K-230KClaude API | Cloud Architecture | Data Science | Evaluation | LLMSenior-level Full TimeLondon, UK R1d ago
-
Junior Data Engineer GBP 28K-28KAzure | Data Governance | Data Management | Data Modeling | Data SecurityAnnual leave | Flexible working | Free GP consultations | Loans | Mortgage adviceEntry-level Full TimeMilton Keynes, Milton Keynes, MK9 1EA, …1d ago
-
Senior AI / LLM Engineer GBP 70K-85KAI Studio | Agent Orchestration | Azure AI | Azure AI Studio | Azure AKSDiscretionary bonus scheme | Employee discount | Employee sample sales | Flexible benefits allowance | Paid annual leaveSenior-level Full TimeLondon, England, United Kingdom1d ago
-
Senior Data Engineer GBP 65K-85KAccess Controls | Alerting | Apache Airflow | Azure Data | Azure Data FactoryHybrid work options | Industry-leading technology | Remote work options | Well-being programs | Work flexibilitySenior-level Full TimeBasingstoke, United Kingdom R1d ago
-
Senior-level Full TimeLondon, United Kingdom1d ago
-
Causal Inference | Machine Learning | Model Productionization | Personalization | PythonContinuous learning | Flexible working | High-ownership environment | Hybrid workingSenior-level Full TimeLondon - The River Building HQ1d ago
-
Senior Data Engineer GBP 70K-80KAgile | Automated testing | Azure Data | Azure Data Factory | Azure SQLHealthcare industry experience | Mentoring and team leadership | Mostly remoteSenior-level Full TimeBrighton1d ago
-
Data Engineer GBP 44K-44KAPI Integration | Agile | Azure Data | Azure Data Factory | CI/CDHybrid workingSenior-level Full TimeManchester R1d ago
-
Mid-level Full TimeLondon, UK1d ago
-
APIs | Agent systems | Cloud platform | Evaluation | Google CloudSenior-level Full TimeLondon, UK1d ago
-
Data Consultant GBP 45K-65KAWS | Analytics | BI Dashboards | ClickHouse | Data ModelingHealth insurance | Hybrid work | Paid time offMid-level Full TimeHybrid - London R1d ago
-
Senior Machine Learning Engineer GBP 80K-115KAPIs | AWS | AWS Lambda | Amazon CloudWatch | Amazon ECRSenior-level Full TimeBelfast1d ago
-
AWS Glue | AWS Lambda | AWS Step Functions | Amazon Athena | Amazon QuickSightFlexible benefits | Life assurance | LinkedIn Learning access | Paid Holidays | Pension planSenior-level Full TimeHybrid, London, England, United Kingdom R1d ago
-
Senior Software Engineer, Data GBP 80K-100KAirflow | Azure | Blob Storage | Cloud Storage | Data IntegrityHybrid work | On-call rotationSenior-level Full TimeLondon R1d ago
-
Mid-level Full TimeWelwyn, United Kingdom1d ago
-
Apache Spark | Azure | Azure Data | Azure Data Lake | Azure DatabricksAnnual bonus | Flexible working | Life assurance | Paid Time Off Volunteering | Paid holidaySenior-level Full TimeThe Bridge, United Kingdom1d ago
-
Senior Data Quality Engineer GBP 72K-80KAirflow | Apache Beam | Apache Kafka | BDD | BehaveDiscounted shopping | Flexible working | Hybrid working | Job share | Paid time offSenior-level Full TimeBristol Harbourside, United Kingdom R1d ago
-
Senior Data Engineer GBP 56K-66KAI | Access Controls | Analytics | Azure | Cloud Computing35 hour working week | Annual leave | Christmas closure | Employee networks | Flexible workingSenior-level Full TimeAQA Manchester, United Kingdom1d ago