模型推理系统工程师
Tasks
- Adapt inference backends including TensorRT TensorRT-LLM ONNX Runtime vLLM SGLang
- Build on device model inference backend
- Collaborate with training interaction and infra teams to support stable robot demos
- Construct inference engines and version management
- Develop model export and quantization pipelines
- Implement model gateway interfaces including infer stream cancel warmup health metrics
- Perform performance analysis including TTFT P95 P99 latency memory and throughput
- Support SLM VLM and TTS model inference
- Validate structured logging and edge cloud alignment stability
Perks/Benefits
- N/A
Skills/Tech-stack
Batching | C++ | CUDA | CUDA graph | FP8 | GRPC | HTTP | INT8 | Inference engine | KV cache | Linux | Model Quantization | Multi-threading | ONNX Runtime | Performance Profiling | Python | SGLang | Streaming inference | TensorRT | TensorRT Plugin | TensorRT-LLM | Triton | VLLM | Warmup
Education
N/A
Related jobs
-
Entry-level Full Time深圳5h ago
-
None Full Time上海、深圳、武汉、北京5h ago
-
提前批-Ai数据产品经理 CNY 144K-240KAPI Integration | Agentic Workflows | Knowledge graph | LLM | Ontology ModelingSenior-level Full Time上海5h ago
-
None Full Time北京、上海5h ago
-
None Full Time上海、北京、深圳5h ago
-
Senior-level Full Time上海、北京、深圳5h ago
-
Entry-level Full Time上海5h ago
-
机器人交互数据与评测工程师 CNY 36K-42KBenchmarking | Data Governance | Data Mining | Data Quality | Data VersioningNone Full Time上海5h ago
-
Senior-level Full Time上海7h ago
-
Entry-level Full Time广州、上海7h ago
-
Entry-level Internship苏州7h ago
-
AI Foundation Model方向实习生 CNY 25K-37KC++ | Caffe | Computer Vision | Data Structures | Data Structures and AlgorithmsEntry-level Internship北京、上海7h ago
-
Ai产品经理 CNY 144K-240KArtificial Intelligence | Data analytics | Data cleaning | Data collection | Data synchronizationEntry-level Full Time深圳8h ago
-
Mid-level Full Time深圳 R8h ago
-
【27届校招提前批】算法工程师 CNY 180K-360KAgent collaboration | Asynchronous programming | Caching | Concurrency | Context engineeringNone Full Time上海8h ago
-
Entry-level Full Time北京8h ago
-
Entry-level InternshipBeijing,Beijing,China16h ago
-
Automation | Cost Optimization | Evaluation | Guardrails | JavaScriptFast hiring process | Remote workMid-level Full TimeChina23h ago
-
APIs | Agents | Cost Optimization | Data integration | EvaluationRemote workMid-level Full TimeChina1d ago
-
Mid-level Full Time东莞1d ago
-
Dba 数据库工程师-2027届 CNY 180K-300KDatabase high availability | Database performance | Database performance tuning | Go | High AvailabilityNone Full Time北京、上海1d ago
-
C# | C++ | Camera Calibration | Computer Vision | Depth EstimationMid-level Full TimeShanghai, Shanghai, China1d ago
-
Senior-level Full TimeChina, Shanghai1d ago
-
Autonomous Vehicles | C# | C++ | Computer Architecture | Computer VisionSenior-level Full TimeChina, Shanghai1d ago
-
Mid-level Full Time北京 R1d ago