Backend Inference Framework Engineer Graduate (AML Inference) - 2027 Start
Tasks
- Design inference service architecture
- Diagnose performance bottlenecks
- Implement canary release
- Implement inference engine scheduling
- Implement model inference services
- Improve stability under high concurrency
- Optimize distributed high concurrency service architecture
- Optimize inference framework core modules
- Select and innovate inference technologies
- Set up monitoring and alerting
- Standardize technical system
Perks/Benefits
- N/A
Skills/Tech-stack
Alerting | C++ | Canary Release | Concurrency | Data Structures | Data Structures and Algorithms | Distributed Systems | GPU Service Resource Management | GRPC | Linux | Monitoring | Multithreading | Performance Tuning | Redis | Resource Management | RocksDB | Synchronization | Thread pool
Education
Related jobs
-
Alerting | Automated rollback | C++ | CI/CD | Canary DeploymentSenior-level Full TimeSingapore, Singapore5h ago
-
C++ developer - Analytical Database SGD 153K-199KAlgorithms | C# | C++ | ClickHouse | Data StructuresSenior-level Full TimeSingapore, Singapore5h ago
-
Apache Flink | Apache FlinkDataStream | Apache HBase | Apache Spark | Apache YARNMid-level Full TimeSingapore, Singapore5h ago
-
Click Through Rate | Click Through Rate Prediction | Conversion Rate | Conversion Rate Prediction | Deep learningSenior-level Full TimeSingapore, Singapore5h ago
-
Algorithms | CTR Prediction | CVR Prediction | Data Structures | Deep learningSenior-level Full TimeSingapore, Singapore5h ago
-
C++ | Fine Tuning | Graph Algorithms | Human Feedback | Inference OptimizationSenior-level Full TimeSingapore, Singapore5h ago
-
Agent Frameworks | Algorithms | C plus plus | Data Structures | Fine TuningMid-level Full TimeSingapore, Singapore5h ago
-
Batch Processing | C# | C++ | Data Architecture | Distributed ConsensusMid-level Full TimeSingapore, Singapore5h ago
-
Batch Processing | C++ | Columnar Storage | Data Warehousing | DeltaLakeMid-level Full TimeSingapore, Singapore5h ago
-
Machine Learning Engineer - Search Ranking SGD 120K-199KAlgorithms | C++ | Computer Vision | Data Structures | Generative ModelsSenior-level Full TimeSingapore, Singapore5h ago
-
Machine Learning Engineer - Search (NLP) - Singapore SGD 70K-108KComputer Vision | Data Structures | Data Structures and Algorithms | Deep learning | Distributed SystemsMid-level Full TimeSingapore, Singapore5h ago
-
Machine Learning Engineer - Vertical Search SGD 164K-282KAlgorithms | C++ | Data Structures | Information Retrieval | JavaEntry-level Full TimeSingapore, Singapore5h ago
-
Behavioral Data | Behavioral data modeling | Computer Vision | Data Modeling | Data StructuresConference recognition | Publication record recognition | Team management opportunitiesSenior-level Full TimeSingapore, Singapore5h ago
-
Software Engineer in Machine Learning Infra, Recommendation Architecture (ByteDance Singapore) SGD 122K-207KC++ | CUDA | CUDNN | Data Processing | DebuggingSenior-level Full TimeSingapore, Singapore5h ago
-
Software Engineer in Machine Learning Infra - Recommendation Architecture (ByteDance Singapore) SGD 122K-207KC++ | CUDA | CUDNN | Computer Architecture | Data ProcessingSenior-level Full TimeSingapore, Singapore5h ago
-
Apache Spark | C++ | Data Mining | Data Modeling | Data VisualizationSenior-level Full TimeSingapore, Singapore5h ago
-
C++ | Data Mining | Data Modeling | Data Warehousing | Distributed SystemsSenior-level Full TimeSingapore, Singapore5h ago
-
Apache Kafka | Apache Spark | C++ | Data Mining | Data ModelingSenior-level Full TimeSingapore, Singapore5h ago
-
C++ | Data Mining | Data Modeling | Elasticsearch | FlinkSenior-level Full TimeSingapore, Singapore5h ago
-
Backend Engineer, Large Model Knowledge System/Content understanding/RAG (ByteDance Singapore) SGD 149K-225KC++ | CUDA | Concurrency systems | Go | High PerformanceEntry-level Full TimeSingapore, Singapore5h ago
-
Backend Engineer - Large Model Knowledge System/Content understanding/RAG (ByteDance Singapore) SGD 123K-145KBilling | C++ | CUDA | Cloud Computing | Database systemsMid-level Full TimeSingapore, Singapore5h ago
-
Algorithms | Computer Vision | Data Structures | Deep learning | Information RetrievalSenior-level Full TimeSingapore, Singapore5h ago
-
Algorithms | Computer Vision | Data Structures | Hyperscale Machine Learning | Language ProcessingSenior-level Full TimeSingapore, Singapore5h ago
-
C# | C++ | CUDA | CUDNN | CompilersSenior-level Full TimeSingapore, Singapore5h ago
-
Activation functions | C# | C++ | CUDA | Computation GraphEntry-level Full TimeSingapore, Singapore5h ago