Inference Systems Backend Engineer - ARK Large Model Platform (Singapore)
Tasks
- Apply model quantization
- Collaborate with algorithm teams to optimize models and systems
- Develop large model training and inference systems
- Implement compiler optimization
- Improve compute utilization with elastic scheduling
- Improve high concurrency reliability and scalability
- Integrate GPUs NPUs and TPUs
- Optimize model computation
- Orchestrate tasks across distributed GPU clusters
- Research model training and inference architectures
- Schedule large scale inference traffic
- Tune distributed LLM inference systems
Perks/Benefits
- N/A
Skills/Tech-stack
Compiler optimization | Deep learning | Distributed Systems | Elastic Scheduling | GPU Computing | GPU scheduling | High Availability | High concurrency | Language Models | Large Language Models | Linux | Machine Learning | Model Quantization | NPU | Python | Scalability | TPU | Task Orchestration
Education
N/A
Related jobs
-
Machine Learning Engineer - Global Payment - Singapore SGD 150K-222KAutomation | Data Intelligence | Feature Engineering | Fraud Detection | Learning algorithmsSenior-level Full TimeSingapore, Singapore3h ago
-
Distributed Systems | Functional testing | Performance Tuning | Scalability | Storage SystemsEntry-level Full TimeSingapore, Singapore3h ago
-
Alerting | CI/CD | Canary Deployment | Capacity forecasting | Cost attributionExecutive-level Full TimeSingapore, Singapore3h ago
-
Cluster management | DevOps | Distributed Systems | Kubernetes | LinuxSenior-level Full TimeSingapore, Singapore3h ago
-
Audit | Automated testing | Backup | Disaster Recovery | DockerEntry-level Full TimeSingapore, Singapore3h ago
-
AI Solution Architect - BytePlus SGD 90K-165KApache Flink | Apache Spark | Caching | Docker | FastAPISenior-level Full TimeSingapore, Singapore3h ago
-
Computer Vision | Human Feedback | Information Retrieval | Language Models | Language ProcessingEntry-level Full TimeSingapore, Singapore3h ago
-
Machine Learning Engineer Graduate (Global E-Commerce, Recommendation) - 2026 Start (BS/MS) SGD 70K-91KA/B | A/B Testing | B testing | Data Pipelines | Data ProcessingEntry-level Full TimeSingapore, Singapore3h ago
-
Computer Vision | Human Feedback | Information Retrieval | Language Models | Language ProcessingEntry-level Full TimeSingapore, Singapore3h ago
-
Anomaly Detection | Data Analysis | Data Pipelines | Fraud Detection | Machine LearningEntry-level Full TimeSingapore, Singapore3h ago
-
Behavior Modeling | Click Through Rate | Click Through Rate Prediction | Conversion Rate | Conversion Rate PredictionCareer development | Graduate onboardingEntry-level Full TimeSingapore, Singapore3h ago
-
Machine Learning Engineer Graduate (Global E-Commerce, Platform Governance) - 2026 Start (BS/MS) SGD 84K-91KData Mining | Data Modeling | Feature Engineering | Graph Databases | Graph LearningEntry-level Full TimeSingapore, Singapore3h ago
-
Software Engineer Graduate (Recommendation Ecosystem Infrastructure) - 2026 Start (BS/MS) SGD 70K-81KData Architecture | Data Management | Distributed Systems | File Formats | LakehouseEntry-level Full TimeSingapore, Singapore3h ago
-
Analytics | Computing systems | Data Mining | Data Modeling | Data ProcessingEntry-level Full TimeSingapore, Singapore3h ago
-
Computer Science | Data Storage | Distributed Systems | Mathematical Analysis | Network softwareEntry-level Full TimeSingapore, Singapore3h ago
-
Behavior Modeling | Blended Ranking | CTR Prediction | CVR Prediction | Coarse RankingSenior-level Full TimeSingapore, Singapore3h ago
-
Behavior Modeling | CTR Prediction | CVR Prediction | Information Retrieval | Machine LearningSenior-level Full TimeSingapore, Singapore3h ago
-
Agent systems | Fine Tuning | Inference Optimization | Knowledge representation | LLM InferenceSenior-level Full TimeSingapore, Singapore3h ago
-
Automated decision making | Conversational AI | Decision Making | Fine Tuning | Inference OptimizationSenior-level Full TimeSingapore, Singapore3h ago
-
Apache HBase | Batch Processing | Data Lake | Database Design | Distributed SystemsSenior-level Full TimeSingapore, Singapore3h ago
-
Batch Processing | Data Lake | Data Storage | Distributed Systems | HBaseSenior-level Full TimeSingapore, Singapore3h ago
-
Information Retrieval | Language Processing | Machine Learning | Multimodal | Natural LanguageEntry-level Full TimeSingapore, Singapore3h ago
-
Generative Models | Information Retrieval | Language Models | Large Language Models | Machine LearningSenior-level Full TimeSingapore, Singapore3h ago
-
Machine Learning Engineer - Search (NLP) - Singapore SGD 60K-108KComputer Vision | Data Processing | Deep learning | Distributed Systems | Entity recognitionMid-level Full TimeSingapore, Singapore3h ago
-
Tech Lead, Machine Learning Engineer - Search E-commerce SGD 146K-191KBehavioral analytics | Computer Vision | Data Modeling | Ecommerce | Language ProcessingSenior-level Full TimeSingapore, Singapore3h ago