Senior Lead Software Engineer - LLM Ops Platform Reliability
GBP 84K-109K (estimate) Senior-level Full Time
Tasks
- Automate remediation for recurring operational issues
- Build and manage multi agent systems for orchestration
- Build backend APIs for reliable AI operations
- Deploy and lifecycle manage large language models using infrastructure as code
- Design and develop secure production services
- Implement observability with logs, metrics, and traces
- Lead incident response and post incident root cause analysis
- Lead reliability engineering for large language model endpoints
- Operate and scale large language model serving infrastructure
- Tune GPU and accelerator capacity for inference cost performance
Perks/Benefits
- N/A
Skills/Tech-stack
Amazon SageMaker | Autoscaling | Capacity Planning | Cause analysis | Cloud infrastructure | Container Orchestration | Continuous Delivery | CrewAI | Distributed tracing | Drift Detection | Failover | GPU | Hallucination detection | Incident Management | Inference Server | Infrastructure as Code | Instrumentation | KServe | Kubernetes | Langchain | Langgraph | Latency optimization | Load Balancing | Load Testing | Logging | Metrics | Model versioning | NVIDIA Triton | NVIDIA Triton Inference | NVIDIA Triton Inference Server | Observability | Open Telemetry | Parallelism | Prompt and Response Logging | Python | Quantization | Ray Serve | Reliability Engineering | Retrieval-Augmented Generation | Root Cause Analysis | Root cause | Runbooks | Safe Rollouts | Site Reliability | Site Reliability Engineering | Soak Testing | Speculative decoding | System design | Testing | Throughput Optimization | Toxicity Filtering | Triton Inference Server | Vector Search | “as-code”
Education
N/A
Related jobs
-
APIs | Agent systems | Cloud platform | Cost Per | Cost Per RequestSenior-level Full TimeLondon, UK2h ago
-
Founding AI Engineer (Staff) GBP 65K-120KAWS | ClickHouse | Distributed Systems | Incident Management | Langgraph30 days annual leave | Employee Health Insurance | Regular team offsites and trips | Visa sponsorship | Weekly team dinners and socialsSenior-level Full TimeLondon1d ago
-
Staff Applied Scientist GBP 110K-160KCloud Computing | Data Analysis | Deep learning | Git | GitHubFlexible remote work | Hybrid work model | Mentoring and coaching | Share options | Team meetups via Slack and ZoomSenior-level Full TimeLondon1d ago
-
AI Engineer USD 100K-250KBackend Development | Context Management | Evaluation Pipeline | Postgres | Prompt engineeringEquity | Free meals | Private medical insurance | Visa sponsorshipEntry-level Full TimeLondon1d ago
-
Agile | C# | C++ | Computer Vision | Data StructuresDiversity and inclusion | Innovation-driven culture | International company | Learning opportunities | Professional growthMid-level Full TimeGBR, London, United Kingdom1d ago
-
AWS CDK | AWS Glue | AWS Lambda | Agile | Amazon KinesisGlobal experience | Immigration supportMid-level Full TimeLondon, United Kingdom1d ago
-
C++ | Data Mining | Distributed Computing | Generative AI | High PerformanceGlobal experience | Immigration supportMid-level Full TimeLondon, United Kingdom1d ago
-
Data Engineer GBP 46K-52KAzure | Azure Databricks | CI/CD | PythonBonus scheme | Discounts and perks | Employee assistance programme | Generous holiday entitlement | Hybrid workingMid-level Full TimeSentinel Building, Glasgow, United Kingdom2d ago
-
Sr. Specialist Solutions Architect GBP 78K-120KAI Observability | AWS | Agent Orchestration | Agentic Systems | Apache SparkSenior-level Full TimeLondon, United Kingdom2d ago
-
Data Analyst, Product GBP 95K-124KA/B | A/B Testing | Analytical Functions | Apache Airflow | B testingSenior-level Full TimeUnited Kingdom2d ago
-
Machine Learning Engineer GBP 55K-55KAzure Machine Learning | Clustering | Data Monitoring | Decision Trees | DevOpsHybrid working | Opportunities for coaching and mentoringMid-level Full TimeManchester, Greater Manchester, United Kingdom2d ago
-
Bash | Data Processing | Docker | GCP | Infrastructure as CodeAsynchronous culture | Flexible management | Remote workMid-level Full TimeLondon, United Kingdom2d ago
-
Senior Data Systems Software Engineer GBP 80K-106KA/B | A/B Testing | API | API Versioning | Application ExpressFlexible medical insurance | Life insurance | Retirement options | Volunteer programsSenior-level Full TimeLONDON, United Kingdom2d ago
-
Blameless postmortems | C++ | Distributed Systems | Fault Tolerance | JavaSenior-level Full TimeLondon2d ago
-
Applied statistics | Artificial Intelligence | Digital Signal | Digital Signal Processing | Edge ComputingHybrid workingSenior-level Full TimeUnited Kingdom3d ago
-
Intermediate Data Engineer GBP 40K-45KAWS | AWS RDS | Branching | CI/CD | CloudFormationAnnual hackathon events | Cycle to work scheme | Electric vehicle scheme | Flexible working | Health and wellbeing programmeMid-level Full TimeNorth West UK - Hybrid R3d ago
-
Data Engineer - AI/ML (f/m/d) GBP 50K-60KAWS | Agile | Azure | Azure Data | Azure Data FactoryFlexi-Week | Health and wellbeing support | Hybrid remote working | Peer to peer recognition voucher | Remote Working FurnitureMid-level Full TimeBerlin, Berlin, Germany; Iași, Iași, Romania; …3d ago
-
Annotation | Computer Vision | Computer Vision Pipelines | Data Preprocessing | GDPRBirthday off | Company celebrations | Equity plan | Flexible working hours | Global team outingsSenior-level Full TimeUnited Kingdom3d ago
-
AI Business Enablement - Senior Associate GBP 90K-126KAPI Integration | Agent Orchestration | Embeddings | Function Calling | Language ModelsSenior-level Full TimeLONDON, LONDON, United Kingdom3d ago
-
Mid-level Full TimeLondon, UK3d ago
-
Bash | Cloud platform | Data Processing | Docker | GCPAsynchronous culture | Friendly work environment | Remote friendly settingMid-level Full TimeBristol, United Kingdom3d ago
-
Bash | Cloud platform | Data Processing | Docker | Google CloudAsynchronous culture | Friendly work environment | Impactful product | Professional growthMid-level Full TimeLeeds, United Kingdom3d ago
-
Mid-level Full TimeYork, United Kingdom3d ago
-
Principal Data Engineer GBP 80K-103KArchitecture | Automation | Code Quality | Continuous integration | Data Engineering30 days holiday | Discount on retailer products | Flexible working | Hybrid working | Inclusive cultureSenior-level Full TimeLiverpool, England, United Kingdom3d ago
-
Quantitative Analyst GBP 84K-119KAgents | Artificial Intelligence | Financial markets | Language Models | Language ProcessingMid-level Full TimeLondon, United Kingdom3d ago