AI Software Engineer Intern
CHN - Minhang, China
CNY 38K-50K (estimate) Entry-level Full Time Internship
Tasks
- Apply model quantization
- Build MoE routing and load balancing
- Develop GPU kernels for tensor workloads
- Develop speculative decoding
- Implement expert parallelism and sharding
- Implement flash attention and paged attention
- Implement optimized LLM inference techniques
- Implement runtime scheduling and batching
- Integrate end to end inference stack
- Optimize KV cache and memory management
- Optimize distributed inference communication
- Optimize memory access patterns
- Perform operator fusion and kernel efficiency tuning
- Study LLM inference research
- Tune multi GPU multi node performance
Perks/Benefits
Skills/Tech-stack
CUDA | Distributed Systems | FP8 | FasterTransformer | Flash Attention | GPU Architecture | GPU Programming | INT8 | KV cache | Low-bit quantization | MOE | Memory Management | Mixture of Experts | NCCL | Operator fusion | Paged Attention | Parallel Computing | Performance Profiling | PyTorch | Python | Quantization | Speculative decoding | TensorRT-LLM | Transformers | Triton | VLLM
Education
Related jobs
-
None Full Time深圳1d ago
-
Senior-level Full TimeShanghai, China1d ago
-
Sr. Consultant - Data Scientist CNY 360K-540KAgile | Computer Vision | Containerization | Data Governance | Data ScienceEmployee assistance program | Mindfulness programs | On demand digital course library | Personalized wellbeing programs | Volunteer matching programSenior-level Full TimeChina Shanghai (Hongmei)1d ago
-
AI Software Engineering Intern CNY 60K-60KAI Agents | Agent systems | Data Pipelines | Deep learning | Fine TuningCareer development opportunities | On-site work environmentEntry-level Full Time InternshipCHN - Beijing, China1d ago
-
Mid-level Full Time北京 R1d ago
-
大模型算法研究员-MiMo CNY 500K-500KActive Learning | C++ | Curriculum learning | Data Generation | Deep learningEntry-level Full Time北京1d ago
-
Miclaw-端云协同调度专家 (Hybrid AI Architect) CNY 240K-480K5G | Cloud API | Consistency protocols | Data Compression | Data PrivacyHybrid workSenior-level Full Time北京 R1d ago
-
Entry-level Full Time北京 R2d ago
-
高级算法工程师(Nlp方向) CNY 240K-480KAgent Development | Agent development tools | Agent memory | CUDA | ChromaSenior-level Full Time北京2d ago
-
Entry-level Full Time北京 R2d ago
-
Mid-level Full Time北京 R2d ago
-
具身智能算法工程师-模型 CNY 500K-500KActor-critic | Deep learning | Distributed Training | Implicit Q Learning | Inference accelerationMid-level Full Time北京 R2d ago
-
Entry-level Full Time北京2d ago
-
AI基础设施研发工程师(Sandbox / 容器化)-MiMo CNY 180K-420KAppArmor | Argo Workflows | CPU resource scheduling | Cgroup | ContainerdMid-level Full Time北京 R2d ago
-
大模型 Infra 研发实习生(Agentic RL 方向) CNY 25K-37KAsynchronous programming | Concurrency | Distributed Systems | Docker | GitEntry-level Internship深圳2d ago
-
Ai应用工程师(提效方向 0-1) CNY 50K-50KAI Programming | AI Programming Tools | API Integration | JavaScript | Language ProcessingEngineering resource support | Hands-on product development | Model and compute support | Real world usageEntry-level Internship深圳2d ago
-
Entry-level Full Time北京2d ago
-
Entry-level Internship北京2d ago
-
大语言模型后训练/Agentic算法工程师 CNY 180K-360KAgentic RL | DAPO | Distributed Training | Function Calling | GRPOEntry-level Full Time上海、北京2d ago
-
大模型 Infra 研发实习生(Agentic RL 方向) CNY 25K-37KAlerting | Asynchronous programming | Concurrency | Data pipeline | Distributed SystemsEntry-level Internship深圳2d ago
-
大模型 Infra 研发实习生(Agentic RL 方向) CNY 25K-37KAsynchronous programming | Concurrency | Distributed Systems | Docker | GitFlexible work schedule | Internship opportunity | MentorshipEntry-level Internship深圳2d ago
-
Entry-level Full Time北京、上海2d ago
-
AGI 服务端资深工程师-Talkie&星野 CNY 180K-300KData Engineering | Dify | Distributed Systems | Go | Inference OptimizationMid-level Full Time北京、上海2d ago
-
Feature Engineering | Machine Learning | Python | Quantitative FinanceAccess to proprietary platforms | Collaborative work environment | Decision-making participation | Mentorship | Potential full-time conversionEntry-level InternshipBeijing, Beijing, China2d ago
-
Mid-level Full TimeBeijing, China2d ago