Staff Machine Learning Engineer, ML Infrastructure - Online
CNY 360K-600K (estimate) Senior-level Full Time
Tasks
- Automate model packaging and deployment workflows
- Build and improve model serving systems
- Build autoscaling and self healing capabilities
- Design online inference infrastructure for low latency and reliability
- Develop model deployment and validation infrastructure
- Implement dynamic batching and request scheduling
- Implement traffic splitting and rollback
- Improve observability for online ML systems
- Lead architectural improvements for scalability and cost efficiency
- Optimize inference performance
- Set up canary testing and A B experimentation
Perks/Benefits
- Commute subsidy
- Disability insurance
- Employee stock ownership
- Generous vacation
- Health insurance
- Life insurance
- Mental health & wellbeing programs
- Retirement plan
- Training and development programs
Skills/Tech-stack
A/B | A/B Experimentation | Autoscaling | Caching | Canary testing | Deployment Automation | Distributed Systems | Dynamic batching | Error Rate Monitoring | Error rate | GKE | GPU Acceleration | GPU Kernel | GPU kernel optimization | Google Kubernetes | Google Kubernetes Engine | Inference Server | Kernel optimization | Kubernetes | Kubernetes Engine | Latency optimization | Model Validation | Model compilation | Monitoring | NVIDIA Triton | NVIDIA Triton Inference | NVIDIA Triton Inference Server | Observability | PyTorch | Python | Quantization | Rate monitoring | Ray | Ray Serve | Rollback | Runtime tuning | TensorFlow Serving | Throughput Optimization | Torchserve | Traffic splitting | Triton Inference | Triton Inference Server
Education
N/A
Related jobs
-
Mid-level Full TimeBeijing, China12h ago
-
数据开发主任 CNY 300K-420KAWS Lambda | AWS Redshift | AWS S3 | Amazon EMR | Apache AirflowCareer growth | Mentorship | Multi cloud platform experienceExecutive-level Full TimeGuangzhou, GD, CN16h ago
-
Entry-level Internship上海22h ago
-
多模态大模型数据工程师 CNY 25K-37KCorpus | Data Augmentation | Data Quality | Data Validation | Data pipelineInternship experienceEntry-level Internship北京22h ago
-
Mid-level Full Time上海22h ago
-
AVP, AI Solution Lead CNY 144K-240KArtificial Intelligence | Cloud Native | DataOps | DevOps | FlutterContinuous professional development | Flexible workingSenior-level Full TimeGuangzhou, Guangdong, China R1d ago
-
Active Directory | Amazon Web Services | Ansible | Apache Airflow | Apache KafkaMid-level Full TimeShanghai, SH, CN1d ago
-
AVP, AI Solution Lead CNY 144K-240KCloud Native | Cloud deployment | DataOps | DevOps | FlutterContinuous professional development | Flexible working | Inclusive work environmentSenior-level Full TimeGuangzhou, GD, CN, 5106201d ago
-
AWS | Access Control | Alerting | Authentication | AzureEmployee networks | Flexible work/life support | Inclusive development opportunities | Paid volunteer daysMid-level Full TimeHangzhou, China1d ago
-
Entry-level Full Time深圳1d ago
-
None Full Time上海、深圳、武汉、北京1d ago
-
None Full Time北京、上海1d ago
-
Mid-level Full Time上海、圣何塞1d ago
-
None Full Time上海、北京、深圳1d ago
-
Senior-level Full Time上海、北京、深圳1d ago
-
Entry-level Full Time上海1d ago
-
机器人交互数据与评测工程师 CNY 36K-42KBenchmarking | Data Governance | Data Mining | Data Quality | Data VersioningNone Full Time上海1d ago
-
None Full Time上海1d ago
-
Deep Learning Performance Architect CNY 144K-240KComputer Architecture | Deep learning | Hardware performance | Hardware performance analysis | Inference OptimizationSenior-level Full TimeChina, Shanghai1d ago
-
Senior-level Full Time上海1d ago
-
Entry-level Full Time广州、上海1d ago
-
Entry-level Internship苏州1d ago
-
AI Foundation Model方向实习生 CNY 25K-37KC++ | Caffe | Computer Vision | Data Structures | Data Structures and AlgorithmsEntry-level Internship北京、上海1d ago
-
Mid-level Full Time深圳 R1d ago
-
【27届校招提前批】算法工程师 CNY 180K-360KAgent collaboration | Asynchronous programming | Caching | Concurrency | Context engineeringNone Full Time上海1d ago