Production Support Engineer — LLM Platform
Tasks
- Build diagnostic tooling
- Build monitoring automation
- Configure alerting
- Coordinate incident resolution with vendors
- Coordinate with Cloud & Infrastructure teams
- Coordinate with end user teams
- Coordinate with platform engineering
- Create dashboards
- Determine root cause platform side or upstream
- Diagnose issues after upstream releases
- Execute staged rollouts
- Investigate model serving issues
- Maintain operational documentation
- Maintain platform stability
- Maintain runbooks
- Measure latency throughput error rate capacity
- Monitor platform availability
- Perform release management
- Provide first line support
- Provide second line support
- Provide user status communication
- Rollback changes
- Support API clients
- Support coding assistants
- Support developer workspaces
- Triage incidents
- Troubleshoot LLM gateway tooling layer
- Troubleshoot provider integrations
- Validate in non production
Perks/Benefits
- N/A
Skills/Tech-stack
AWS | Alerting | Ansible | Bash | Bedrock | CI/CD | Caching | CloudWatch | Connection Reset | Dashboards | Docker | Error rate | Grafana | HTTP | IAM | Infrastructure as Code | Kubernetes | Latency | Linux | Logs | Metrics | Monitoring | Networking | Observability | Percentile Latency | PostgreSQL | Powershell | Prometheus | Python | Rate Limiting | Retries | SQL | SQL Server | Terraform | Throughput | Time Out | Traces | Windows | “as-code”
Education
N/A
Related jobs
-
Alerting | Argo Workflows | ArgoCD | Azure | Azure DevOpsMid-level Full TimeKai Tak, Hong Kong1d ago
-
Senior Data Management Professional - Data Engineering - Sustainable Fixed Income Data, Hong Kong HKD 150K-200KAlerting | CSV | Cause analysis | Data Architecture | Data ModelingSenior-level Full TimeHong Kong1d ago
-
Principal Consultant - Data Scientist Lead HKD 150K-230KApache Spark | Automated testing | CI/CD | Cloud Compute Engine | Cloud StorageHybrid work | Training and certificationsSenior-level Full TimeChina - Hong Kong1d ago
-
Storage Operations Engineer HKD 300K-300KAnsible | Docker | GitLab | Golang | GrafanaWork-life balance programsMid-level Full TimeHong Kong1d ago
-
Deep learning | Generative AI | Language Processing | MLOps | Machine LearningMid-level Full TimeHong Kong, Hong Kong2d ago
-
Executive-level Full TimeHong Kong, HK, HK3d ago
-
Asia Group Functions Senior Data Engineer HKD 104K-132KAgile | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageCareer growth | Flexible work environment | Well-being and inclusionSenior-level Full TimeHong Kong, Manulife Tower R3d ago
-
Asia Group Functions Lead Data Engineer HKD 104K-132KActive Directory | Azure Active Directory | Azure Data | Azure Data Factory | Azure Data LakeFlexible work environment | Hybrid work arrangement | Inclusion support | Wellbeing supportSenior-level Full TimeHong Kong, Manulife Tower R3d ago
-
2027 Internship/Graduate - Data Engineer HKD 70K-90KAlgorithms | Coding | Data Structures | NoSQL | Object-OrientedCollaborative environment | Fast-paced environment | Mentorship | Potential full-time offerEntry-level InternshipHong Kong3d ago
-
Bash | C# | C++ | GCC | GitFull-time conversion opportunity | MentorshipEntry-level InternshipHong Kong/Singapore/Shanghai3d ago
-
Quantitative Developer | Trading Team SGD 133K-140KAnsible | Bash | C++ | CI/CD | DebuggingHybrid work environment | Trading hours responsivenessMid-level Full TimeSingapore, Hong Kong R4d ago
-
AML | Alert optimization | Apache HBase | Apache Hadoop | Apache HiveExecutive-level Full TimeHong Kong (City Area)5d ago
-
Senior-level Full TimeHong Kong6d ago
-
AI Engineer HKD 312K-312KAI Agents | APIs | Automation frameworks | Browser Automation | Cloud ComputingMid-level Full TimeHong Kong, Hong Kong10d ago
-
Alerting | Argo Workflows | ArgoCD | Azure DevOps | Bitbucket CloudAI infrastructure engineering exposure | Multi cloud migration exposure | Proof of concept projectsMid-level Full TimeKai Tak, Hong Kong10d ago
-
Global Banking & Markets, Prime Brokerage Client Analytics Strats, Associate, Hong Kong HKD 330K-340KAdvanced Statistics | Agentic AI | Big Data | C++ | Data EngineeringEntry-level Full TimeHong Kong, Hong Kong10d ago
-
Software Engineer - Data Platform HKD 300K-300KCloud infrastructure | Container Orchestration | Data Quality | Great Expectations | KubernetesWork-life balance programsMid-level Full TimeHong Kong10d ago
-
Senior-level Full TimeHong Kong, HK, HK11d ago
-
Quantitative Developer - Equity Volatility Execution HKD 150K-215KAeron | Automated testing | C++ | CI/CD | ConcurrencySenior-level Full TimeHong Kong, Hong Kong11d ago
-
Senior ML Engineer HKD 150K-200KAPI Development | Agentic Workflows | Alerting | Automated testing | AzureHybrid work arrangementSenior-level Full TimeHong Kong, Manulife Tower R11d ago
-
Mid-level Full TimeHong Kong, HK, HK11d ago
-
Bash | Cloud platform | Data Processing | Docker | GCPAsynchronous culture | Competitive salary | Friendly work environment | Remote-firstMid-level Full TimeHong Kong, Hong Kong12d ago
-
Software Engineer - Systematic Data Platform HKD 160K-240KAlgorithms | Amazon Redshift | Data Structures | Google BigQuery | JavaSenior-level Full TimeHong Kong, Hong Kong12d ago
-
Senior Data Engineer HKD 101K-130KApache Spark | Azure | Azure Data | Azure Data Factory | Azure Data LakeFlexible work environment | Hybrid work arrangement | Inclusion focus | Well-being supportSenior-level Full TimeHong Kong, Manulife Financial Centre R12d ago
-
[LPS] Senior Data Engineer HKD 38KApache Kafka | Apache Spark | Cloud Computing | Data Modeling | ETLSenior-level Full TimeHong Kong, Hong Kong12d ago