Senior Machine Learning Engineer, ML Infrastructure - Online
CNY 360K-600K (estimate) Senior-level Full Time
Tasks
- Build model deployment workflows
- Design and operate online inference infrastructure
- Implement autoscaling and self healing
- Implement canary testing and A/B experimentation
- Improve observability of online ML systems
- Lead architectural improvements for reliability scalability and cost efficiency
- Optimize inference performance
- Optimize model packaging and deployment automation
- Serve production machine learning models with low latency
- Split traffic and perform rollback
- Validate and monitor model performance in production
Perks/Benefits
- Commute subsidy
- Competitive retirement pension plans
- Employee resource groups
- Employee stock ownership
- Generous vacation
- Global employee assistance program
- Mental health and wellbeing programs
- Training and development
- Volunteering and donation matching
Skills/Tech-stack
A/B | A/B Testing | Autoscaling | B testing | Canary testing | Cost monitoring | Distributed Systems | Dynamic batching | Error Rate Monitoring | Error rate | GPU Acceleration | GPU Kernel | GPU kernel optimization | Google Kubernetes | Google Kubernetes Engine | Inference Optimization | Inference Server | Kernel optimization | Kubernetes | Kubernetes Engine | Latency optimization | Machine Learning | Model Deployment | Model compilation | Monitoring | NVIDIA Triton | NVIDIA Triton Inference | NVIDIA Triton Inference Server | Observability | PyTorch | Python | Quantization | Rate monitoring | Ray Serve | Request Scheduling | Rollback | Runtime tuning | TensorFlow Serving | Throughput Optimization | Torchserve | Traffic splitting | Triton Inference Server
Education
N/A
Related jobs
-
Entry-level Internship上海10h ago
-
多模态大模型数据工程师 CNY 25K-37KCorpus | Data Augmentation | Data Quality | Data Validation | Data pipelineInternship experienceEntry-level Internship北京10h ago
-
Mid-level Full Time上海10h ago
-
AVP, AI Solution Lead CNY 144K-240KArtificial Intelligence | Cloud Native | DataOps | DevOps | FlutterContinuous professional development | Flexible workingSenior-level Full TimeGuangzhou, Guangdong, China R19h ago
-
Active Directory | Amazon Web Services | Ansible | Apache Airflow | Apache KafkaMid-level Full TimeShanghai, SH, CN1d ago
-
AVP, AI Solution Lead CNY 144K-240KCloud Native | Cloud deployment | DataOps | DevOps | FlutterContinuous professional development | Flexible working | Inclusive work environmentSenior-level Full TimeGuangzhou, GD, CN, 5106201d ago
-
Entry-level Full Time深圳1d ago
-
None Full Time上海、深圳、武汉、北京1d ago
-
None Full Time北京、上海1d ago
-
Mid-level Full Time上海、圣何塞1d ago
-
None Full Time上海、北京、深圳1d ago
-
Senior-level Full Time上海、北京、深圳1d ago
-
Entry-level Full Time上海1d ago
-
机器人交互数据与评测工程师 CNY 36K-42KBenchmarking | Data Governance | Data Mining | Data Quality | Data VersioningNone Full Time上海1d ago
-
None Full Time上海1d ago
-
Deep Learning Performance Architect CNY 144K-240KComputer Architecture | Deep learning | Hardware performance | Hardware performance analysis | Inference OptimizationSenior-level Full TimeChina, Shanghai1d ago
-
Senior-level Full Time上海1d ago
-
Entry-level Full Time广州、上海1d ago
-
Entry-level Internship苏州1d ago
-
AI Foundation Model方向实习生 CNY 25K-37KC++ | Caffe | Computer Vision | Data Structures | Data Structures and AlgorithmsEntry-level Internship北京、上海1d ago
-
Mid-level Full Time深圳 R1d ago
-
【27届校招提前批】算法工程师 CNY 180K-360KAgent collaboration | Asynchronous programming | Caching | Concurrency | Context engineeringNone Full Time上海1d ago
-
Entry-level Full Time北京1d ago
-
Entry-level InternshipBeijing,Beijing,China1d ago
-
Mid-level Full TimeBeijing, China1d ago