Lead Software Engineer – LLM Ops Platform Reliability
GLASGOW, LANARKSHIRE, United Kingdom
GBP 80K-110K (estimate) Senior-level Full Time
Tasks
- Automate remediation for recurring operational issues
- Build backend services and APIs for reliable production operations
- Conduct root-cause analysis and write post-incident follow-ups
- Deploy and manage LLMs on Amazon EKS and Amazon SageMaker
- Design secure production software for AI infrastructure
- Implement observability with logs, metrics, and traces
- Lead incident response and mitigation
- Operate and scale LLM serving infrastructure
- Perform capacity planning and load testing for LLM endpoints
- Tune GPU and accelerator capacity for LLM inference
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | Alertmanager | Amazon EKS | Amazon SageMaker | Autoscaling | Blue-Green Deployment | Blue/green | Cache optimization | Canary | Canary Deployment | Cause analysis | Continuous Delivery | GPU | Grafana | Incident Management | Infrastructure as Code | KV cache | KV cache optimization | Kubernetes | LLM | Load Testing | Observability | OpenTelemetry | Parallelism | Prometheus | Python | Quantization | Reliability Engineering | Root Cause Analysis | Root cause | Site Reliability | Site Reliability Engineering | Speculative decoding | System design | Terraform | VLLM | “as-code”
Education
N/A
Related jobs
-
AWS | Apache Spark | Cloud platform | Data Engineering | Data WarehousingSenior-level Full TimeLondon, United Kingdom22h ago
-
Applied AI Engineer - Finance Super App (UK) GBP 35K-50KAPIs | Agents | Data integration | Evaluation | LLM APIsHealth insurance | Hybrid work | Professional development opportunitiesMid-level Full TimeUnited Kingdom23h ago
-
Senior-level Contract Full TimeLondon, England, United Kingdom1d ago
-
Senior AI Engineer GBP 78K-100KAWS | Anomaly Detection | Computer Vision | Data Modeling | Decision TreesAI experimentation budget | Equity | Group life assurance | Hybrid working | Income protectionSenior-level Full TimeLondon1d ago
-
Staff Applied Scientist GBP 110K-160KBlack | Cloud Computing | Complex Planning | Deep learning | Explainable AIFlexible remote work | Generous share options | Hybrid work options | Mentoring and coaching culture | Tax efficient EMI share option schemeSenior-level Full TimeLondon1d ago
-
Senior Applied Scientist GBP 100K-120KBlack | Cloud Computing | Complex Planning | Data Analysis | Deep learningHybrid work | Mentoring and coaching | Share optionsSenior-level Full TimeLondon1d ago
-
Senior Machine Learning Software Engineer GBP 56K-70K3D Imaging | 4D Imaging | Azure DevOps | C++ | CPU OptimizationAccredited Learning and Development Programmes | Bereavement leave | Company sick pay | Cycle to work scheme | Early finish every FridaySenior-level Full TimeBelfast, GB1d ago
-
APIs | Agent systems | Cloud platform | CrewAI | EvaluationAccess to advanced AI models | Customer-facing work | White glove deploymentMid-level Full TimeLondon, UK2d ago
-
API Integration | Agent systems | Cloud platform | Cost Optimization | CrewAISenior-level Full TimeLondon, UK2d ago
-
APIs | Agent systems | Artificial Intelligence | Cloud platform | CrewAISenior-level Full TimeLondon, UK2d ago
-
AI Architect, Partner Engineering GBP 100K-120KAgent systems | AlloyDB AI | BigQuery | BigQuery Zero Copy | C++Senior-level Full TimeLondon, UK; Zürich, Switzerland2d ago
-
Bash | Cloud platform | Data Processing | Docker | Google CloudAsynchronous work culture | Flexible management approach | Remote-friendly, distributed teamMid-level Full TimeEdinburgh, United Kingdom2d ago
-
Bash | Cloud platform | Data Ingestion | Data Processing | DockerAsynchronous culture | Diverse and inclusive workplace | Impactful mission | Laid-back atmosphereMid-level Full TimeBirmingham, United Kingdom2d ago
-
Bash | Cloud platform | Data Processing | Docker | Google CloudAsynchronous culture | Career impact | Flexible work environment | Remote-friendly environmentMid-level Full TimeNottingham, United Kingdom2d ago
-
Bash | Cloud platform | Data Ingestion | Data Processing | DockerAsynchronous work culture | Flexible management style | Remote-friendly setupMid-level Full TimeGlasgow, United Kingdom2d ago
-
Software Engineer (Inference Platform), London GBP 130K-186KCI/CD | Cloud platform | Distributed Systems | GPU | Google CloudHybrid workExecutive-level Full TimeLondon R2d ago
-
Senior Machine Learning Engineer GBP 70K-85KAutomated testing | CI/CD | Containerization | Deep learning | Distributed TrainingEmployee discount | Employee sample sales | Flexible benefits allowance | Paid annual leave | Personalised learningSenior-level Full TimeLondon, England, United Kingdom2d ago
-
Machine Learning Engineer GBP 70K-85KCI/CD | Containerization | Deep learning | Distributed Computing | GPU ComputingEmployee discount | Employee sample sales | Paid annual leave | Personalized learning | Private medical careEntry-level Full TimeLondon, England, United Kingdom2d ago
-
Sr Security Engineer, Incident Response GBP 91K-120KAI | AWS | Access Control | Agentic Platforms | Azure24x7 on call schedule | Distributed OperationsSenior-level Full TimeBelgium; Finland; Remote - Denmark; Remote … R3d ago
-
Senior MLOps Engineer GBP 27K-27KAI Agent Builder | AWS | Agent Builder | Azure | BigQueryBirthday off | Broadband discounts | Cycle2work scheme | Dental insurance | Employee discount platform accessSenior-level Full TimeReading3d ago
-
Analytics Engineer GBP 27K-34KAzure | DBT | Data Modeling | ELT | FivetranAnniversary rewards | Cycle to work scheme | Dog-friendly offices | Enhanced parental leave | Free drinks and snacksEntry-level Full TimeLondon3d ago
-
AI Research Engineer - AI Safety GBP 61K-130KAdversarial Machine Learning | Adversarial Robustness | Bayesian Inference | C++ | CalibrationEnhanced parental leave | Gym membership | Learning allowance | Mental health support | Paid Family Emergency LeaveMid-level Full TimeBerlin; London; Munich R3d ago
-
Research Engineer, Continual Learning, DeepMind GBP 100K-180KAccelerators | Benchmarking | C++ | Data Engineering | Data VisualizationMid-level Full TimeLondon, UK3d ago
-
Agent Development | Agent Development Kit | Agent systems | Agentic Workflows | Computer VisionSenior-level Full TimeLondon, UK3d ago
-
Principal Data Engineer (Product Data) GBP 80K-100KCI/CD | DBT | Data Contracts | Data Quality | Data TestingCareer growth development programs | Flexible time off plans | Flexible work schedules | Health and wellness benefitsSenior-level Full TimeAntrim, Northern Ireland, United Kingdom; Remote- … R3d ago