大模型推理架构师
Tasks
- Automate tuning and resource scheduling
- Build AI compilation and model optimization pipeline
- Build AI training and inference infrastructure
- Design end to end AI system architecture
- Develop high-performance inference engine
- Develop performance analysis and observability tools
- Diagnose system failures and bottlenecks
- Implement model compiler and graph optimizations
- Improve GPU and NPU utilization
- Optimize distributed training performance
- Optimize heterogeneous compute kernels
- Optimize large scale distributed training and inference
- Reduce latency and increase throughput
- Validate and deploy new LLM system techniques in production
Perks/Benefits
- N/A
Skills/Tech-stack
Ascend C | C plus plus | C# | CUDA | CUDA kernel | Checkpointing | Communication overlap | Cutlass | Data-parallel | DeepSpeed | Distributed Data Parallel | Distributed data | FSDP | Graph optimization | Infiniband | KV cache | LLVM | MLIR | Megatron | Mixture of Experts | Model compilation | NCCL | NVSHMEM | Offloading | Pipeline parallelism | PyTorch | Python | Quantization | RDMA | RoCE | SGLang | TVM | Tensor Parallelism | TensorRT-LLM | Torch Dynamo | TorchInductor | Transformer | Triton | Triton Compiler | VLLM | Verbs | XLA | Zero
Education
Bachelor of Engineering | Bachelor of Science | Master of Science | PhD
Related jobs
-
Entry-level Full Time上海7h ago
-
自动驾驶系统开发高级/资深工程师（L4 Robotaxi） CNY 180K-300KActive Safety | Autonomous Driving | C++ | Control | End to EndMid-level Full Time广州 R8h ago
-
高级影像高级算法工程师（博士） CNY 240K-480KC++ | Computer Vision | Deep learning | Face Recognition | Image RecognitionSenior-level Full TimeShenzhen9h ago
-
Mid-level Full Time深圳、长沙9h ago
-
Entry-level Full Time深圳、杭州9h ago
-
Mid-level Full Time深圳、上海、杭州9h ago
-
Entry-level Full Time深圳9h ago
-
Senior-level Full TimeShanghai, China16h ago
-
Mid-level Full TimeShanghai, CN16h ago
-
ASIL 3 | ASPICE | AUTOSAR | AUTOSAR safety | C#Global collaboration opportunities | Worldwide team meetingsMid-level Full TimeShanghai, CN16h ago
-
AWQ | AWS | Accelerate | Azure | BatchingSenior-level Full TimeGuangzhou, Guangdong, China R1d ago
-
Automation & Robotics Engineer CNY 360K-600KActuator integration | Analog Signal | Artificial Intelligence | C++ | CADSenior-level Full TimeHangzhou, China1d ago
-
Data Analytics & Management, AVP CNY 300K-420KAgentic AI | Alteryx | Anomaly Detection | Classification | Code DevelopmentFlexible work/life support | Inclusive development opportunities | Paid volunteer days | Vibrant employee networksExecutive-level Full TimeHangzhou, China1d ago
-
C# | C++ | Fine Tuning | GPU Acceleration | InferenceCareer development | Mentorship guidance | Onsite collaborationMid-level Full TimeCHN - Minhang, China1d ago
-
AI Agents | C++ | Co Optimization | Fine Tuning | GPU AccelerationCareer development | Mentorship | On-site collaborationMid-level Full TimeCHN - Minhang, China1d ago
-
Automation & Robotics Engineer CNY 360K-600KAllen Bradley | Artificial Intelligence | C++ | Control Systems | FanucSenior-level Full TimeHangzhou, China1d ago
-
Entry-level Internship上海1d ago
-
Senior-level Full Time上海、北京1d ago
-
Entry-level Internship上海1d ago
-
Mid-level Full Time上海1d ago
-
Mid-level Full Time上海、深圳 R1d ago
-
Mid-level Full Time上海1d ago
-
Senior-level Full Time上海1d ago
-
Mid-level Full Time北京、上海1d ago
-
Entry-level Full Time上海1d ago