软件工程师 - 大模型端侧优化和部署
Tasks
- Build benchmarking and profiling system
- Deploy large language models on automotive edge chip platform
- Develop CUDA operators for real time inference
- Implement low latency multimodal inference features
- Improve latency throughput and memory efficiency
- Optimize KV cache and sampling methods
- Optimize inference engine and runtime performance
Perks/Benefits
- N/A
Skills/Tech-stack
Attention | Batching | C++ | CUDA | Computational Graph Optimization | Computational graph | Decode | Function Calling | Graph optimization | KV cache | LLM | Linux | Multimodal inference | ONNX Runtime | Operator fusion | Prefill | Python | SGLang | Streaming | Structured Output | TensorRT | TensorRT-LLM | Transformer | VLLM | VLM
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Roles
Regions
Countries
States
Related jobs
-
Mid-level Full TimeShanghai7h ago
-
【校招实习生】系统研发工程师 CNY 75K-75KAI Agent | Alertmanager | ArgoCD | CI/CD | Cloud ComputingAI development tools access | Hands-on project experience | Internal training | One to one mentorship | Technical workshopsEntry-level Internship北京7h ago
-
Senior Software Engineer (RAG Backend Developer) CNY 277K-370KA/B | A/B Testing | ABAC | Access Control | Audit LoggingSenior-level Full TimeGuangzhou, Guangdong, China R21h ago
-
Asynchronous Communication | C plus plus | Continuous batching | Data parallelism | Deep learningOn-site workEntry-level Full TimeCHN - Minhang, China1d ago
-
Senior Perception Engineer CNY 144K-240KBEV perception | C++ | Computer Vision | Data pipeline | Deep learningSenior-level Full Time5-8F TOWER C, 788 JINZHONG ROAD, …1d ago
-
Senior-level Full TimeCHN - Wuxi - Plastics - …1d ago
-
Data Analytics & Management, Senior Associate CNY 144K-240KAlteryx | Anomaly Detection | Artificial Intelligence | Classification | Code platformsEmployee networks | Flexible work/life support | Inclusive development opportunities | Paid volunteer daysSenior-level Full TimeHangzhou, China1d ago
-
Mid-level Full Time北京1d ago
-
None Full Time上海1d ago
-
Entry-level Internship上海1d ago
-
AI software application developers (CG) CNY 84K-120KAI | Algorithms | Benchmarking | C# | C++Career growth | Continuous learning | Onsite workEntry-level Full TimeCHN - Minhang, China2d ago
-
AI Framework Software Engineer - vLLM CNY 300K-420KAsynchronous Communication | C++ | Data parallelism | Deep learning | Distributed SystemsEntry-level Full TimeCHN - Minhang, China2d ago
-
Mid-level Full TimeXian, Shaanxi, China2d ago
-
Mid-level Full TimeShanghai, China2d ago
-
AI Frameworks Engineer - Model and Kernel Optimization CNY 160K-240KC++ | Deep learning | GPU Programming | Kernel development | PyTorchOn-site workSenior-level Full TimeCHN - Minhang, China2d ago
-
AI Framework Software Engineer – PyTorch CNY 74K-100KC++ | Debugging | Deep learning | Distributed Computing | GPU OptimizationOn-site workEntry-level Full TimeCHN - Minhang, China2d ago
-
AI Compiler and Library Engineer CNY 60K-60KAssembly | C# | C++ | Deep learning | JavaCollaborative environment | Hands-on projects | On-site workEntry-level Full TimeCHN - Minhang, China2d ago
-
Data Analyst Engineer A1 CNY 360K-510KAgile | Bash | CI/CD | CSS | CloudEmployee networks | Flexible work/life support | Inclusive development opportunities | Paid volunteer daysSenior-level Full TimeHangzhou, China2d ago
-
Senior-level Full TimeCHN - ZJ - Hangzhou, Innovation …2d ago
-
Mid-level Full Time北京2d ago
-
AI基础设施研发工程师（Sandbox / 容器化)-MiMo CNY 144K-240KAlerting | AppArmor | Argo Workflows | CI/CD | CPU SchedulingMid-level Full Time北京2d ago
-
Senior-level Full Time北京2d ago
-
Algorithms | Artificial Intelligence | Concurrency | Containerization | Data StructuresMid-level Full TimeShanghai2d ago
-
Apache Flink | Apache Kafka | Apache Spark | Apache Superset | Data GovernanceMid-level Full TimeShanghai2d ago
-
Machine Learning Engineer CNY 180K-360KAndroid | C# | C++ | Convolutional Neural Network | Deep learningEntry-level Full TimeShanghai, China3d ago