大模型训练与推理Infra工程师-MiMo
Tasks
- Analyze and optimize data loading and communication
- Build online offline inference framework
- Collaborate with research teams on training and inference requirements
- Design distributed training compute platform
- Develop distributed training framework
- Develop performance monitoring and tooling
- Implement inference optimization techniques
- Integrate high-performance computing technologies
- Optimize hardware utilization
- Optimize inference latency memory and energy usage
- Optimize training efficiency and resource utilization
- Support model deployment for product teams
Perks/Benefits
- N/A
Skills/Tech-stack
C++ | CUDA | CUDNN | Context caching | DeepSpeed | Docker | Horovod | JAX | Kubernetes | MPI | Mixed Precision | Mixed-precision training | Model Deployment | NCCL | Pruning | PyTorch | Python | Quantization | Ray | TensorFlow | Terraform
Education
Bachelor of Engineering | Bachelor of Science | Master of Science | PhD
Related jobs
-
Entry-level Full Time北京 R8h ago
-
Nlp / Llm 应用工程师 CNY 180K-360KAgent evaluation | Anthropic API | Automated testing | Chroma | DeepEvalEntry-level Full Time北京 R9h ago
-
Mid-level Full Time北京 R9h ago
-
Mid-level Full Time北京 R9h ago
-
AI基础设施研发工程师（Sandbox / 容器化)-MiMo CNY 180K-420KAppArmor | Argo Workflows | CI/CD | CPU resource scheduling | CgroupMid-level Full Time北京 R9h ago
-
Entry-level Full Time北京、上海 R2d ago
-
Behavior Cloning | C++ | Cloud processing | Computer Vision | ControlEntry-level Internship北京、上海 R4d ago
-
Mid-level Full Time上海、深圳 R4d ago
-
AI platforms | API Development | Artificial Intelligence | Cloud AI | Cloud AI PlatformsMid-level Full TimeRemote, China R5d ago
-
AI ML Engineer CNY 280K-360KAWS | Azure | C++ | Cloud Computing | Computer VisionPerformance bonuses | Professional development opportunities | Remote workMid-level Full TimeShenzhen, Guangdong Province, China R8d ago
-
API Development | Artificial Intelligence | Cloud Computing | Data Pipelines | Data integrationMid-level Full TimeRemote, China R9d ago
-
AI工程师-Agent Memory & RAG 方向（成都） CNY 240K-480KBERT | Chroma | Cross-Encoder | Embedding Models | FaissSenior-level Full Time成都 R9d ago
-
AI工程师-Agent Memory & RAG 方向（武汉） CNY 240K-480KAlgorithms | BERT | Chroma | Cross-Encoder | Data StructuresSenior-level Full Time武汉 R9d ago
-
AI工程师-Agent Memory & RAG 方向（北京） CNY 240K-480KBERT | Chroma | Cross-Encoder | Embedding Models | FaissSenior-level Full Time北京 R9d ago
-
AWS | Agent Orchestration | Agent systems | Azure | DockerMid-level Full TimeShenzhen, Guangdong, China R10d ago
-
AVP, AI Solution Lead CNY 360K-600KCloud Computing | DataOps | DevOps | Flutter | Generative AIContinuous professional development | Flexible workingSenior-level Full TimeGuangzhou, Guangdong, China R10d ago
-
Analytics Modelling CNY 360K-600KAWS | BigQuery | Cloud platform | Google Cloud | Google Cloud PlatformContinuous professional development | Flexible working | Inclusive and diverse environment | Opportunities for growthSenior-level Full TimeGuangzhou, Guangdong, China R10d ago
-
AWQ | AWS | Accelerate | Azure | BatchingMid-level Full TimeShenzhen, Guangdong, China R10d ago
-
JMP_ AI Operation Excellence Expert（VM） CNY 240K-480KAI Agents | API | Cloud Native | Data Governance | Digital TwinSenior-level Full TimeSuzhou, Jiangsu, China R15d ago
-
Generative AI - ML System Engineering CNY 360K-600KC++ | CUDA | Compilation | Data pipeline | Diffusion ModelsFully remote option | On-site work flexibilitySenior-level Full TimeShanghai R15d ago
-
Lead Embedded Software Engineer CNY 349K-437KARM | BLE | C# | C++ | Embedded LinuxHybrid work model | Remote-friendly | Work from homeSenior-level Full TimeSuzhou, China R17d ago
-
Mid-level Full Time上海、深圳 R22d ago
-
模型部署与推理优化工程师 CNY 180K-360KC++ | Edge inference | Inference Performance | Inference Performance Optimization | Model DistillationMid-level Full Time北京 R29d ago
-
Entry-level Internship上海 R29d ago
-
Mid-level Full Time北京 R1mo ago