Senior LLM Inference Performance & Evaluation Engineer
Singapore, SG / Penang, MY / Taiwan
TWD 1700K-2300K (estimate) Senior-level Full Time
Tasks
- Automate regression detection in CI CD
- Build benchmark pipelines
- Compare model runtime provider options
- Convert benchmark results into SLOs and alert thresholds
- Create model launch gates
- Identify performance bottlenecks
- Maintain representative workloads
Perks/Benefits
Skills/Tech-stack
Benchmarking | CI/CD | Concurrency | Dashboards | GPU Utilization | Go | Kubernetes | Latency optimization | Machine Learning | Model Evaluation | Performance Engineering | Python | Quality Assurance | Regression testing | Synthetic Monitoring | Synthetic Workloads | Test automation
Education
N/A
Related jobs
-
Data Engineer, ANZSA SGD 150K-210KAPI Integration | Amazon Redshift | CI/CD | Data Governance | Data ModelingMid-level Full TimeSingapore4h ago
-
Lead Software Engineer, Perception (Robotics) SGD 155K-238K3D Perception | C++ | Camera | Camera Calibration | Cause analysisBirthday leave | FlexWork | Insurance | Medical insurance | Parental leaveSenior-level Full TimeSingapore, Singapore6h ago
-
資深軟韌體工程師 (Senior Embedded SW/Firmware Engineer) TWD 480K-480KAgile | C# | CI/CD | Embedded Linux | IPMISenior-level Full TimeTaipei Neihu, Taiwan12h ago
-
Software Engineer, Machine Learning SGD 74K-74KBias Mitigation | Data Structures | Ethical AI | Graph theory | IndexingSenior-level Full TimeSingapore1d ago
-
Senior Inference Runtime Engineer TWD 1900K-2500KCUDA | CUDA profiling | Continuous batching | Distributed inference | GPU Memory OptimizationFlexible work culture | Inclusive environment | Training and mentoringSenior-level Full TimeSingapore, SG / Penang, MY / …1d ago
-
Cloud Storage Engineer TWD 1700K-2500KBeeGFS | CI/CD | Caching | Capacity Planning | CephAutonomy | Fast growth learning opportunities | Inclusive environment | Training and mentoring | Welfare benefitsSenior-level Full TimeSingapore, SG / Penang, MY / …1d ago
-
AI Integration Engineer SGD 60K-108KAPI Key | Audit Logging | BACnet | Code Integration | EncryptionFlexible working arrangements | Professional developmentMid-level Full TimeSJ Campus, Singapore1d ago
-
Entry-level Full TimeTaichung - Fab 16, Taiwan1d ago
-
Domain Randomization | Imitation Learning | IsaacGym | IsaacLab | JAXFast feedback cycles | High impact work on real robots | Open source contributionsMid-level Full TimeSingapore1d ago
-
C++ | Localization | Mapping | Motion Planning | NavigationCompetitive compensation | EquitySenior-level Full TimeSingapore1d ago
-
Autonomy | C++ | Contact Rich Control | Control Theory | Data collectionCompetitive compensation | Equity | Open source contributionsMid-level Full TimeSingapore1d ago
-
AI Engineer (GenAI / RAG / LangGraph / Python) SGD 74K-74KAgent systems | Anthropic Claude | Azure OpenAI | CI/CD | ChromaSenior-level Contract Full TimeSingapore, Singapore, Singapore2d ago
-
Classifier Modeling | Data Mining | Data Structures | Data Structures and Algorithms | Machine LearningSenior-level Full TimeSingapore3d ago
-
Tech Expert/Backend Engineer - Global Live (LLM) SGD 150K-190KAmazon RDS | Big Data | C++ | Golang | JavaSenior-level Full TimeSingapore3d ago
-
C++ | Cloud Computing | Data Modeling | Data Pipelines | ETLSenior-level Full TimeSingapore3d ago
-
AWS | Algorithms | Apache Airflow | Apache Pinot | Apache SparkSenior-level Full TimeTaipei, Taiwan; Tokyo, Japan3d ago
-
Senior Databricks Consulting Engineer SGD 175K-221KAWS | Apache Kafka | Apache Spark | Azure | Cloud ArchitectureContinuous learning and certification support | Remote friendly working environmentSenior-level Full TimeSingapore3d ago
-
APIs | Azure | Azure Data | Azure Data Explorer | Azure DevOpsOnsite workMid-level Full TimeSingapore, Singapore3d ago
-
.NET | AKS | API Integration | Agent Orchestration | Agent systemsSenior-level Full TimeSingapore, Singapore3d ago
-
AWS | Anomaly Detection | Anomaly detection models | Azure | ClassificationSenior-level Full TimeSingapore, Singapore3d ago
-
Senior-level Full TimeSingapore, Singapore3d ago
-
Senior AI Engineer USD 200K-300KCost Optimization | Fine Tuning | GPU Monitoring | GPU scheduling | Hugging FaceDental insurance | Dependent care options | Flexible spending account | Flexible vacation | Group term life insuranceSenior-level Full TimeChicago; Hong Kong; London; New York; …3d ago
-
Software Engineering, Machine Learning SGD 74K-74KArtificial Intelligence | C# | C++ | Code review | Data MiningSenior-level Full TimeSingapore4d ago
-
Software Engineer, Applied AI, Pixel TWD 2175K-2900KC++ | Cloud deployment | Computer Vision | Data Processing | Device deploymentMid-level Full TimeNew Taipei, Banqiao District, New Taipei …4d ago
-
AI machine learning | API | Architecture | Cloud infrastructure | Code readingSenior-level Full TimeSingapore4d ago