Senior Machine Learning Engineer, ML Infrastructure - Online
CNY 360K-600K (estimate) Senior-level Full Time
Tasks
- Build model deployment workflows
- Design and operate online inference infrastructure
- Implement autoscaling and self healing
- Implement canary testing and A/B experimentation
- Improve observability of online ML systems
- Lead architectural improvements for reliability scalability and cost efficiency
- Optimize inference performance
- Optimize model packaging and deployment automation
- Serve production machine learning models with low latency
- Split traffic and perform rollback
- Validate and monitor model performance in production
Perks/Benefits
- Commute subsidy
- Competitive retirement pension plans
- Employee resource groups
- Employee stock ownership
- Generous vacation
- Global employee assistance program
- Mental health and wellbeing programs
- Training and development
- Volunteering and donation matching
Skills/Tech-stack
A/B | A/B Testing | Autoscaling | B testing | Canary testing | Cost monitoring | Distributed Systems | Dynamic batching | Error Rate Monitoring | Error rate | GPU Acceleration | GPU Kernel | GPU kernel optimization | Google Kubernetes | Google Kubernetes Engine | Inference Optimization | Inference Server | Kernel optimization | Kubernetes | Kubernetes Engine | Latency optimization | Machine Learning | Model Deployment | Model compilation | Monitoring | NVIDIA Triton | NVIDIA Triton Inference | NVIDIA Triton Inference Server | Observability | PyTorch | Python | Quantization | Rate monitoring | Ray Serve | Request Scheduling | Rollback | Runtime tuning | TensorFlow Serving | Throughput Optimization | Torchserve | Traffic splitting | Triton Inference Server
Education
N/A
Related jobs
-
【2026届春招】AI Infra工程师-算法研发方向 CNY 144K-240KC++ | CUDA | Data parallelism | Distributed Training | HuggingfaceEntry-level Full Time北京、上海 R2d ago
-
Mid-level Full Time北京2d ago
-
Entry-level Internship北京、上海2d ago
-
【校招实习生】AI Infra 工程师-算法研究方向 CNY 25K-37KC++ | CI/CD | CUDA | NCCL | OpenMPIFull-time internship | Open source project opportunitiesEntry-level Internship北京、上海 R2d ago
-
【校招实习生】感知算法工程师 CNY 25K-37KBEV | C plus plus | CenterNet | Computer Vision | DETRInternship opportunityEntry-level Internship北京、上海2d ago
-
Omni模型算法实习生 CNY 25K-37KAblation Study | Annotation Validation | Cross-modal alignment | Data Analysis | Data AnnotationEntry-level Internship北京、深圳2d ago
-
【27届校招】Omni模型算法工程师/研究员 CNY 500K-500KData Engineering | Distributed Training | Inference acceleration | Instruction Tuning | Knowledge DistillationEntry-level Full Time深圳、上海、北京2d ago
-
Mid-level Full Time深圳、北京2d ago
-
Entry-level Full Time深圳2d ago
-
None Full Time深圳 R2d ago
-
【27届校招】具身数据infra工程师 CNY 144K-240KAI Coding Agent | AI coding | API Design | Access Control | Code reviewMid-level Full Time深圳、上海、北京2d ago
-
None Full Time深圳、上海、广州2d ago
-
Omni模型算法实习生 CNY 25K-37KAblation Study | Cross-modal alignment | Data Analysis | Data Annotation | Dataset cleaningEntry-level Internship北京、深圳2d ago
-
【27届校招】Omni模型算法工程师/研究员 CNY 500K-500KContext modeling | Data Engineering | Distributed Training | End to End | End to End GenerationEntry-level Full Time深圳、上海、北京2d ago
-
Mid-level Full Time深圳、北京2d ago
-
Entry-level Full Time深圳2d ago
-
None Full Time深圳 R2d ago
-
【27届校招】具身数据infra工程师 CNY 144K-240KAPI Design | Access Control | Code review | Data Cleansing | Data ProcessingMid-level Full Time深圳、上海、北京2d ago
-
【27届校招】具身智能数据算法工程师 - 人类数据 CNY 144K-240K3D Gaussian Splatting | C++ | COLMAP | DPO | Data AnnotationEntry-level Full Time深圳、上海、广州2d ago
-
大模型规划算法工程师- 北京 CNY 240K-480KAgent planning | Context modeling | Deep learning | Dialogue Understanding | Direct Preference OptimizationMid-level Full Time北京2d ago
-
机器人真机强化学习算法实习生 CNY 25K-37KActor-critic | Data Analysis | GRPO | Multimodal Learning | Offline Reinforcement LearningEntry-level Internship上海2d ago
-
Mid-level Full TimeChangchun, CN2d ago
-
Mid-level Full TimeAIA AI Tech ED (Shanghai) Hongkou, …3d ago
-
Asistant Manager, Data Science CNY 264K-384KAWS | Azure | Docker | GCP | HuggingfaceCommunity initiatives | Learning opportunities | Professional development | Wellbeing supportMid-level Full TimeCHN-Chengdu Branch, China3d ago
-
KERING AI & LLM Engineer CNY 144K-240KAI Agent | AI Agent Development | Agent Development | Dify | LLM APISenior-level Full TimeShanghai, Shanghai, Mainland China3d ago