软件工程师 - 大模型端侧优化和部署
Tasks
- Build benchmarking and profiling for latency throughput memory
- Deliver low latency for function calling and structured output
- Deploy large language models on automotive edge devices
- Develop high performance CUDA operators
- Implement KV cache and speculative sampling
- Optimize computation graphs and fuse operators
- Optimize inference engine and runtime
- Support streaming and multimodal inference
- Tune model switching and cache hit rate
Perks/Benefits
- N/A
Skills/Tech-stack
Attention | Batching | Benchmarking | C++ | CUDA | CUDA kernel | CUDA kernel development | Compute Graph | Compute Graph Optimization | Decode | Efficiency optimization | FP16 | FP8 | Graph optimization | INT4) | INT8 | KV cache | Kernel development | LLM | Linux | Memory Optimization | ONNX Runtime | Operator fusion | Power efficiency | Power efficiency optimization | Prefill | Profiling | Python | SGLang | Streaming | TensorRT Edge-LLM | TensorRT-LLM | Transformer | VLLM | VLM
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Roles
Regions
Countries
States
Related jobs
-
(Senior) Software Engineer, Deep Learning USD 140K-280KAlgorithms | C++ | CUDA | Code optimization | Computational GeometryFamily leave | Free food and snacks | Health care plan | Life insurance | Long-term disabilitySenior-level Full Time费利蒙1d ago
-
Bash | Cloud platform | Data Processing | Docker | GCPAsynchronous culture | Distributed remote work | Friendly and laid-back atmosphere | Opportunity to make impactMid-level Full TimeBeijing, China1d ago
-
Senior-level Full TimeLOC3254: No.3239 Shenjiang Road, Shanghai, Pudong …1d ago
-
Ai全栈工程师 CNY 144K-240KAmazon Web Services | CI/CD | Docker | Express | FastAPIAI tools license | Flexible work hours | Remote work optionSenior-level Full Time北京、南京、苏州2d ago
-
Lead Engineer, Machine Learning CNY 360K-500KCost Optimization | Data Pipelines | Fine Tuning | GPU Optimization | Inference SystemsSenior-level Full TimeChina R2d ago
-
Principal Software Engineer - Apple Data Platform CNY 435K-510KAWS | Airflow | Alibaba Cloud | Automation | C++Senior-level Full TimeShanghai2d ago
-
Cloud & Data Engineer II CNY 435K-510KAWS | CI/CD | Container Security | Data Modeling | Data WarehousingSenior-level Full TimeBeijing, Beijing, CN2d ago
-
AWS | Agent Orchestration | Agent systems | Azure | Cloud platformMid-level Full TimeShenzhen, Guangdong, China R2d ago
-
ANSYS | APDL | Analysis of Variance | C# | Design of ExperimentsNone Full TimeWuhan, Hubei, China2d ago
-
AWS | Access Management | Agentic Workflows | Auditability | AzureMid-level Full TimeShenzhen, GD, CN, 5180102d ago
-
APIs | AWS | Accuracy Optimization | Agent Orchestration | Agent systemsMid-level Full TimeShenzhen, GD, CN, 5180102d ago
-
Data Analytics - Support - AM CNY 336K-420KLanguage Models | Language Processing | Large Language Models | Natural Language | Natural Language ProcessingCommunity initiatives | Flexible benefits | Professional development | Wellbeing supportEntry-level Full TimeCHN-Chengdu Branch, China2d ago
-
Data platform architect CNY 3000KAccess Control | Apache Spark | Auto Loader | Azure Data | Azure Data FactorySenior-level Full TimeCN, Shanghai, China2d ago
-
Deep Learning Solution Architect - Agentic Performance CNY 360K-600KAI Agents | Agentic Inference | Cluster management | Distributed Training | Distributed inferenceSenior-level Full TimeChina, Beijing2d ago
-
Senior-level Full TimeChina, Shanghai2d ago
-
Mid-level Full TimeChina, Shanghai2d ago
-
Entry-level InternshipChina, Beijing2d ago
-
Mid-level Full TimeShanghai, Shanghai, China2d ago
-
AI Infra工程师-算法研发方向 CNY 180K-300KC plus plus | CI/CD | CUDA | Data parallelism | Deep learningEngineering Training | MentorshipMid-level Full Time北京、上海3d ago
-
Entry-level Full Time InternshipShenzhen, Changsha3d ago
-
Entry-level Full Time InternshipChangsha, Shenzhen3d ago
-
Ai全栈工程师(25/26届) CNY 96K-120KAI integration | API Development | Full Stack | Full-Stack Development | GoLearning opportunities | MentorshipEntry-level Full Time InternshipShenzhen, Changsha3d ago
-
API Integration | Agent Design | Agent evaluation | Context engineering | Data EngineeringEntry-level Full Time InternshipShenzhen3d ago
-
AI Software Development Eng. CNY 74K-100KCUDA | Data parallelism | Debugging | DeepSpeed | Distributed TrainingEntry-level Full TimeCN,Shanghai WFOE3d ago
-
Agentic AI Engineer, AVP CNY 300K-420KAWS | AWS Bedrock | Access Management | Agent collaboration | Agentic AIExecutive-level Full TimeHangzhou, China3d ago