Inference Systems Backend Engineer - ARK Large Model Platform (Singapore)
Tasks
- Build distributed LLM inference systems
- Develop large model training and inference systems
- Implement elastic scheduling for distributed GPU clusters
- Integrate heterogeneous accelerators with training and inference frameworks
- Optimize compilers for model workloads
- Optimize model computation and training performance
- Orchestrate training and inference tasks
- Quantize models for inference
- Research and design training and inference architectures
- Schedule large scale inference traffic
- Solve high concurrency, reliability, and scalability issues
- Tune large GPU training clusters
Perks/Benefits
- N/A
Skills/Tech-stack
Compiler optimization | Distributed Systems | Elastic Scheduling | GPU scheduling | High Performance | High-Performance Computing | Language Models | Large Language Models | Machine Learning | Model Quantization | NPU | Performance Computing | TPU | Task Orchestration
Education
N/A
Related jobs
-
Machine Learning Intern, Perception (End-to-end) SGD 45K-56KC++ | Cloud processing | Computer Vision | Deep learning | Machine LearningFlexible working hours | Full time internship duration at least 5 months | Remote work optionEntry-level InternshipSingapore, Central, Singapore9h ago
-
Machine Learning Engineer SGD 138K-178KArtifact tracking | Cloud Computing | Data Lineage | Data orchestration | Data pipelineFitness Events | Free meals | Hybrid work | Paid time off | Volunteer opportunitiesMid-level Full TimeSingapore, Singapore9h ago
-
AI Engineer-3 SGD 100K-170KArtificial Intelligence | Automation | Language Models | Large Language Models | Low CodeRelocation supportMid-level Full TimeSingapore11h ago
-
Computer Vision | Generative Models | Information Retrieval | Language Processing | Machine LearningSenior-level Full TimeSingapore, Singapore23h ago
-
Machine Learning Engineer - TikTok Search Ranking SGD 130K-180KComputer Vision | Generative Models | Information Retrieval | Language Processing | Machine LearningSenior-level Full TimeSingapore, Singapore23h ago
-
Automation | C# | C++ | Crisis management | DNSOn-call rotation | TravelSenior-level Full TimeSingapore1d ago
-
Software Engineer, Content Safety SGD 85K-140KAdversarial Detection | Automation | C++ | Computer Vision | Content processingMid-level Full TimeSingapore1d ago
-
Staff Research Engineer, Applied AI, DeepMind SGD 74K-130KAlgorithms | Cloud Computing | Cloud platform | Data Processing | Data StructuresSenior-level Full TimeSingapore1d ago
-
MGR, Quantitative Developer - Global Markets Division SGD 132K-170KAPI Development | Backtesting | C# | C++ | DatabasesCommunity initiatives | Flexible benefits | Learning and professional development | Wellbeing supportEntry-level Full TimeSGP-Head Office, Singapore1d ago
-
Container Orchestration | Distributed Computing | GPU | High Performance | High-Performance ComputingMid-level Full TimeSingapore1d ago
-
Amazon S3 | Apache Kafka | Concurrency | Data Consistency | Data IngestionSenior-level Full TimeSingapore1d ago
-
Senior Software Engineer, Acceleration Platform SGD 162K-220KAI Safety | C++ | Computer Vision | Data Processing | Data StructuresMentorship | Technical leadershipSenior-level Full TimeSingapore3d ago
-
C++ | CSS | Computer Vision | Data Modeling | Deep learningSenior-level Full TimeSingapore4d ago
-
Azure AI Engineer (Azure AI Foundry & Gen AI) SGD 69K-130KAI Foundry | AI Search | APIs | Agent systems | AutogenMid-level Full TimeSingapore, Singapore, Singapore4d ago
-
Senior-level Contract Full TimeSingapore, Singapore, Singapore4d ago
-
Agile | Big Data | Cloud Platforms | Data Engineering | Data LakesMid-level Full TimeSingapore5d ago
-
Team Lead, Data Science & AI Engineering, Vice President SGD 162K-195KBigQuery | CI/CD | Cloud Storage | Cloud platform | Data PipelinesSenior-level Full TimeBOS-SGP, Singapore5d ago
-
AI Engineer (Azure OpenAI | LLM | RAG | AI Agents) SGD 70K-130KAI Agents | AI Foundry | Azure AI | Azure AI Foundry | Azure Machine LearningMid-level Full TimeSingapore, Singapore, Singapore5d ago
-
Azure AI Engineer SGD 69K-130KAI Foundry | Agent Orchestration | Azure AI | Azure AI Foundry | Azure CognitiveMid-level Full TimeSingapore, Singapore, Singapore5d ago
-
Mid-level Full TimeSingapore5d ago
-
Automation | C# | C++ | Cloud platform | DNSDocumentation updates | Flexible work rotations | Rotating on-call schedule | Travel up to 15 percent in regionMid-level Full TimeSingapore6d ago
-
AI Apprentice SGD 36K-36KJava | Language Models | Language Processing | Large Language Models | Machine LearningEntry-level Apprenticeship Full TimeSingapore, Singapore, Singapore6d ago
-
Solutions Engineer – Artificial Intelligence SGD 160K-220KAWS | Artificial Intelligence | Big Data | Cloud Architecture | Cloud platformCareer development | Employee resource groups | Flexible work from home | Internet reimbursement | Paid time offSenior-level Full TimeSingapore-Singapore6d ago
-
Lead/Senior/ Data Scientist SGD 96K-144KAgentic Workflows | Anomaly Detection | Artificial Intelligence | Clustering | Data Pipelines3-year contractSenior-level Full TimeCAA-Changi Airport Terminal 2, Singapore6d ago
-
AVP, Data Analyst, Infrastructure SGD 130K-210KData Governance | Data Lineage | Data Modeling | Data Pipelines | Data QualityFlexible work schedule | In-office collaboration | Professional growth | Work from home flexibilityExecutive-level Full TimeSingapore, SG6d ago