Lead Software Engineer – LLM Ops Platform Reliability
GLASGOW, LANARKSHIRE, United Kingdom
GBP 80K-110K (estimate) Senior-level Full Time
Tasks
- Automate remediation for recurring operational issues
- Build backend services and APIs for reliable production operations
- Conduct root-cause analysis and write post-incident follow-ups
- Deploy and manage LLMs on Amazon EKS and Amazon SageMaker
- Design secure production software for AI infrastructure
- Implement observability with logs, metrics, and traces
- Lead incident response and mitigation
- Operate and scale LLM serving infrastructure
- Perform capacity planning and load testing for LLM endpoints
- Tune GPU and accelerator capacity for LLM inference
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | Alertmanager | Amazon EKS | Amazon SageMaker | Autoscaling | Blue-Green Deployment | Blue/green | Cache optimization | Canary | Canary Deployment | Cause analysis | Continuous Delivery | GPU | Grafana | Incident Management | Infrastructure as Code | KV cache | KV cache optimization | Kubernetes | LLM | Load Testing | Observability | OpenTelemetry | Parallelism | Prometheus | Python | Quantization | Reliability Engineering | Root Cause Analysis | Root cause | Site Reliability | Site Reliability Engineering | Speculative decoding | System design | Terraform | VLLM | “as-code”
Education
N/A
Related jobs
-
Buildkite | C++ | CI/CD | Camera | Hardware-in-the-loopHybrid work | Work from home daysSenior-level Full TimeLondon R22h ago
-
Robotics Engineer GBP 123K-130KAPI Design | Asynchronous programming | Bayesian Inference | C++ | CUDAHybrid work | Work from home optionsSenior-level Full TimeLondon; Sunnyvale R23h ago
-
Data Engineer (Banking & Investments) GBP 60K-80KAzure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure DevOpsRemote-firstSenior-level Full TimeLondon, United Kingdom1d ago
-
Data Engineer, Global Client Solutions GBP 77K-77KCloud Computing | Data Engineering | Data Fusion | Docker | GitDental insurance | Hybrid work schedule | Medical insurance | Mental Health Awareness Days | Paid time offMid-level Full TimeLondon, United Kingdom1d ago
-
Airflow | BigQuery | Cloud platform | Computer Vision | EmbeddingsBike to work | Coaching benefits | Dental insurance | Family planning support | Flexible vacationSenior-level Full TimeRemote - United Kingdom R1d ago
-
Forward-Deployed Data Scientist II GBP 90K-134KAirflow | CI/CD | CatBoost | Cloud platform | Code reviewDisability coverage | Donation matching | Employee resource groups | Employee stock purchase plan | Flexible paid time offMid-level Full TimeLondon1d ago
-
Causal Inference | Machine Learning | Model Productionization | Personalization | PythonContinuous learning | Flexible working | Hybrid workingSenior-level Full TimeLondon - The River Building HQ1d ago
-
Machine Learning Engineer - Routing & ETA GBP 27K-27KForecasting | Machine Learning | Predictive Modeling | Production Machine Learning | PythonContinuous learning | Flexible working hours | Hybrid workEntry-level Full TimeLondon - The River Building HQ1d ago
-
AI Research Engineer - GPU Simulation GBP 80K-105KC++ | CUDA | Domain Randomization | Flight Dynamics | GPU ProgrammingEnhanced parental leave | Health and wellness gym membership | Learning allowance | Mental health support | Paid Family Emergency LeaveSenior-level Full TimeMunich - Berlin - London - … R1d ago
-
Senior Data Engineer GBP 64K-74KAWS Glue | Apache Airflow | Azure Data | Azure Data Factory | CI/CDHybrid work arrangementSenior-level Full Time17th Floor, 5 Aldermanbury Square, London, … R1d ago
-
Entry-level Full Time17th Floor, 5 Aldermanbury Square, London, …1d ago
-
Senior Data Engineer GBP 72K-80KAccess Control | Airflow | BigQuery | CI/CD | Cloud ComposerAgile working | Career coaching | Enhanced parental leave | Occasional travel for workshops and meetings | Pension matchingSenior-level Full TimeManchester Office1d ago
-
Senior Data Engineer GBP 72K-80KAccess Control | Airflow | BigQuery | CI/CD | Cloud ComposerAgile working | Career coaching | Enhanced parental leave | Pension matching | Private medical coverSenior-level Full TimeHeathrow Office1d ago
-
Senior Data Engineer GBP 72K-80KAPIs | Access Control | Airflow | BigQuery | CI/CDAgile working | Career coaching | Enhanced parental leave | Learning opportunities | Occasional travel for workshopsSenior-level Full TimeLondon Office1d ago
-
Mid-level Full TimeRemote (United States); United Kingdom; Canada R1d ago
-
Senior Data Engineer GBP 70K-75KAWS | Azure | Azure Data | Azure Data Factory | CI/CDBirthday day off | Cycle to work scheme | Enhanced maternity leave | Enhanced paternity leave | Gym discountsSenior-level Full TimeLondon or Manchester UK1d ago
-
API Design | AWS | AWS Bedrock | Apache Airflow | Apache IcebergSenior-level Full TimeGLASGOW, LANARKSHIRE, United Kingdom1d ago
-
Data Platform Engineer GBP 60K-70KAzure | Azure Databricks | Azure DevOps | Azure Monitor | CI/CDFlexible work modelMid-level Full TimeNewcastle, United Kingdom R1d ago
-
AI Solution Lead Engineer GBP 59K-74KAWS | Automation | Azure | CI/CD | Computer VisionAnnual health assessments | Annual leave | Charity matched funding | Cycle to work scheme | Double matched pensionSenior-level Full TimeScottishPower HQ, United Kingdom1d ago
-
Staff Engineer GBP 80K-100KAutomated testing | Containers | Continuous integration | Executorch | Graph optimizationSenior-level Full TimeLocation Cambridge, United Kingdom1d ago
-
Data Engineering Specialist (Snowflake) GBP 72K-80KAWS | Apache Spark | Data Architecture | Data Modeling | Data WarehousingFlexible working arrangements | Hybrid workSenior-level Full TimeWaterloo Street, United Kingdom R1d ago
-
Senior AI Engineer GBP 92K-125KAPIs | AWS | Agent workflows | Alerting | AzureEmployee assistance program | Employee discounts | Flexible working hours | Personal choice budget | Sabbatical leaveSenior-level Full TimeUK - London (London Wall), United …1d ago
-
Forward Deployment Engineer GBP 78K-120KAWS | Artificial Intelligence | Azure | CI/CD | Fine TuningMid-level Full TimeGlasgow Campus, United Kingdom1d ago
-
Senior-level Full TimeCanary Wharf, 1 Churchill Place, United …1d ago
-
AWS | AWS Glue | AWS Lambda | Amazon Athena | Amazon EC2Mid-level Full TimeDerby, United Kingdom1d ago