Inference Systems Backend Engineer - ARK Large Model Platform (Singapore)
Tasks
- Build distributed LLM inference systems
- Develop large model training and inference systems
- Implement elastic scheduling for distributed GPU clusters
- Integrate heterogeneous accelerators with training and inference frameworks
- Optimize compilers for model workloads
- Optimize model computation and training performance
- Orchestrate training and inference tasks
- Quantize models for inference
- Research and design training and inference architectures
- Schedule large scale inference traffic
- Solve high concurrency, reliability, and scalability issues
- Tune large GPU training clusters
Perks/Benefits
- N/A
Skills/Tech-stack
Compiler optimization | Distributed Systems | Elastic Scheduling | GPU scheduling | High Performance | High-Performance Computing | Language Models | Large Language Models | Machine Learning | Model Quantization | NPU | Performance Computing | TPU | Task Orchestration
Education
N/A
Related jobs
-
Senior-level Full TimeSingapore14h ago
-
Artificial Intelligence | Big Data | Data Visualization | Database Programming | HadoopEntry-level Full TimeSingapore21h ago
-
Data & AI Engineer SGD 100K-143KAWS | AWS Glue | AWS Lambda | Airflow | Amazon EC2Mentorship | Professional growthMid-level Full TimeSingapore, Singapore, Singapore22h ago
-
Senior Machine Learning Engineer SGD 74K-130KAlerting | Automated retraining | CI/CD | Data Quality | Feature EngineeringSenior-level Full TimeSG Ensign Kallang Place, L9 (Right …22h ago
-
Machine Learning Engineer SGD 54K-60KData Structures | Information Retrieval | Java | Language Processing | Machine LearningEntry-level Full Time新加坡1d ago
-
Assistant Algorithm Engineer SGD 60K-78KComputer Vision | Deep learning | Machine Learning | PyTorch | TensorFlowEntry-level InternshipSingapore1d ago
-
Backend Engineer - Applied Machine Learning Platform SGD 120K-155KCloud Computing | Data Pipelines | Data Processing | Debugging | Deep learningMid-level Full TimeSingapore, Singapore1d ago
-
Machine Learning Engineer - Logistics Fulfillment SGD 60K-108KAlgorithm Development | Data Modeling | Deep reinforcement learning | Demand forecasting | Dynamic Route PlanningMid-level Full TimeSingapore, Singapore1d ago
-
Accelerator | Data Analysis | Deep learning | Diffusers | Experiment designAutonomy | Career growth | Continuous learning | Flexible distributed environment | Fully remote workMid-level Full TimeSingapore R1d ago
-
Software Engineer, Perception SGD 120K-143K3D Reconstruction | C++ | CUDA | Computer Vision | Deep learningMid-level Full TimeSingapore1d ago
-
Principal AI Architect - Product and Framework SGD 112K-171KAI Agents | API Architecture | APIs | Cloud Native | Enterprise AICareer mobility | Continuous learning | Employee assistance programs | Flexible working hours | Inclusive cultureSenior-level Full TimeSingapore, Singapore1d ago
-
AI Engineer SGD 83K-120KAPIs | Arcpy | Dashboards | Data Pipelines | Deep learningDental insurance | Disability benefits | Employee assistance program | Employee stock purchase plan | Flexible work optionsSenior-level Full TimeSingapore, Singapore1d ago
-
Software Developer - Ozone SGD 140K-191KAlgorithms | Apache HBase | Apache Hadoop | Apache Hive | Apache RatisCareer development access | Employee resource groups | Flexible WFH | Generous PTO | Internet reimbursementSenior-level Full TimeSingapore-Singapore1d ago
-
Customer Success & Insights Engineer SGD 120K-200KAgile methodology | Amazon Web Services | Big Data | Data Analysis | Data EngineeringSenior-level Full TimeSOH02 - Singapore HP Campus Block …1d ago
-
ARM Cortex | ARM Cortex-M | Altium | Analog electronics | C#Senior-level Full TimeSingapore, Singapore, Singapore2d ago
-
Container Orchestration | Distributed Computing | HPC | Kubernetes | LinuxMid-level Full TimeSingapore2d ago
-
A/B | A/B Testing | B testing | Continual Learning | Dataset ConstructionSenior-level Full TimeSingapore, Singapore3d ago
-
GenAI Engineer SGD 165K-220KAI Platform | AI Services | API Integration | AWS Bedrock | AWS FargateSenior-level Full TimeSingapore3d ago
-
BigQuery | Cloud Data Catalog | Cloud Functions | Cloud Storage | Cloud platformMid-level Full TimeSingapore, Singapore4d ago
-
.NET | AKS | Agentic AI | App Service | Azure AppMid-level Full TimeSingapore, Singapore4d ago
-
Content Safety | Data Analysis | Knowledge Base | Knowledge base construction | Language ModelsMid-level Full TimeSingapore, Singapore4d ago
-
Senior Manager (AI Engineer) (Future Capabilities) SGD 120K-156KAI Pipelines | Agentic AI | Artificial Intelligence | CrewAI | Data GovernanceSenior-level Full TimeBCA-JEM, Singapore4d ago
-
Distributed Systems Engineer SGD 160K-200KAmazon S3 | C++ | Concurrency | Data Consistency | Data IngestionSenior-level Full TimeSingapore, Singapore, Singapore5d ago
-
[Lta-Tro] Executive/ Engineer, Innovation & Analytics SGD 245K-375KArcGIS | Artificial Intelligence | Geospatial analysis | Machine Learning | PowerBIExecutive-level Full TimeLTA BCO B1 L3, Singapore5d ago
-
APIs | C++ | Cloud Platforms | Data Pipelines | Deep learningSenior-level Full TimeSingapore, 05, SG, 6371315d ago