AI Software Engineer Intern
CHN - Minhang, China
CNY 38K-50K (estimate) Entry-level Full Time Internship
Tasks
- Apply model quantization
- Build MoE routing and load balancing
- Develop GPU kernels for tensor workloads
- Develop speculative decoding
- Implement expert parallelism and sharding
- Implement flash attention and paged attention
- Implement optimized LLM inference techniques
- Implement runtime scheduling and batching
- Integrate end to end inference stack
- Optimize KV cache and memory management
- Optimize distributed inference communication
- Optimize memory access patterns
- Perform operator fusion and kernel efficiency tuning
- Study LLM inference research
- Tune multi GPU multi node performance
Perks/Benefits
Skills/Tech-stack
CUDA | Distributed Systems | FP8 | FasterTransformer | Flash Attention | GPU Architecture | GPU Programming | INT8 | KV cache | Low-bit quantization | MOE | Memory Management | Mixture of Experts | NCCL | Operator fusion | Paged Attention | Parallel Computing | Performance Profiling | PyTorch | Python | Quantization | Speculative decoding | TensorRT-LLM | Transformers | Triton | VLLM
Education
Related jobs
-
整车体验数据分析实习生(数据产品与Ai方向) CNY 25K-37KData Modeling | Data Quality | Data Visualization | Data cleaning | Data quality monitoringEntry-level Internship上海3h ago
-
Entry-level Full Time广州4h ago
-
Senior-level Full Time上海、北京5h ago
-
Mid-level Full Time北京 R6h ago
-
Miclaw-端云协同调度专家 (Hybrid AI Architect) CNY 240K-360K5G | API Integration | Claude 3.5 | Distributed Systems | GPT-4oHybrid workSenior-level Full Time北京 R6h ago
-
Entry-level Internship北京1d ago
-
Senior Software Engineer - Machine Learning CNY 360K-600KData Analysis | Data Visualization | Deep learning | Experimentation | Fraud DetectionCareer progression | Collaborative culture | Competitive compensation | Global growth opportunitiesSenior-level Full TimeShenzhen, China1d ago
-
AAI Intern-Knowledge Governance Solutions CNY 25K-37KData Analysis | Data Visualization | Data cleaning | Excel | Power BIEntry-level Full Time InternshipBeijing, Beijing, China1d ago
-
AI intern CNY 28K-50KAutomated testing | Continuous integration | Deep learning | Generative AI | JavaEntry-level InternshipBeijing,Beijing,China1d ago
-
Senior Deep Learning Solution Architect CNY 240K-480KAccelerated computing | Computer Systems | Data Structures | Deep learning | Distributed TrainingSenior-level Full TimeChina, Beijing2d ago
-
Senior Consultant Specialist (AI Architect/Tech Lead) CNY 144K-192KAPI Design | AWS | Alibaba Cloud | Automation | CI/CDSenior-level Full TimeGuangzhou, Guangdong, China R2d ago
-
Entry-level Full Time上海3d ago
-
Agent systems | Embodied AI | Human Feedback | Language Models | Large Language ModelsMid-level Full Time深圳、上海4d ago
-
机器学习工程师 – 模型推理优化 CNY 180K-300KModel Distillation | Model Pruning | Model Quantization | Model Sparsity | ONNXEntry-level Full Time北京4d ago
-
Ai 多模态软件工程师(数据飞轮方向) CNY 180K-300KBatch Processing | Data Processing | Feature extraction | Language Models | Large Language ModelsCareer growth | Large-scale project experience | Learning opportunities | Team collaborationMid-level Full Time广州、北京4d ago
-
Mid-level Full Time深圳、上海、北京、中国香港4d ago
-
Entry-level Full Time深圳、北京、上海4d ago
-
大语言模型后训练算法工程师 CNY 240K-480KDistributed Training | Docker | Fine Tuning | Human Feedback | KubernetesMid-level Full Time深圳、上海4d ago
-
Senior-level Full Time广州4d ago
-
Senior-level Full Time上海、深圳4d ago
-
AWQ | AWS | Batching | CPU architecture | CUDASenior-level Full TimeGuangzhou, Guangdong, China4d ago
-
Sr. AI Process Engineer, Seller Compliance CNY 360K-600KAWS | CI/CD | Code review | Data Pipelines | DocumentationSenior-level Full TimeShanghai, CHN5d ago
-
Senior Manufacturing AI Engineer – Machine Learning CNY 144K-240KClustering | Docker | Hypothesis Testing | Kubernetes | LightGBMSenior-level Full TimeChina Jiangmen5d ago
-
AI Framework Software Engineer CNY 300K-420KAsynchronous Communication | C++ | Computational graphs | Data parallelism | Deep learningOn-site work environmentEntry-level Full TimeCHN - Minhang, China5d ago
-
Entry-level Internship上海5d ago