Ai智算平台工程师（Dmc）
Tasks
- Build Prometheus based end to end monitoring
- Deploy large language models with vLLM and Triton
- Design deploy and tune InfiniBand RoCE and distributed storage
- Ensure low latency high availability for online inference
- Implement FinOps cost modeling and elastic scaling
- Implement circuit breaker degradation and rate limiting
- Manage hybrid cloud architecture and ensure data consistency
- Optimize inference using TensorRT quantization and dynamic batching
- Optimize resource scheduling for GPU utilization
- Plan and build GPU cluster infrastructure
- Use AIOps for fault prediction and automated operations
Perks/Benefits
- N/A
Skills/Tech-stack
AIOps | Circuit Breaker | DCGM | Dynamic batching | Elastic scaling | FP8 | FinOps | GPU | Go | Grafana | Hybrid Cloud | INT8 | Infiniband | K8s | Kubernetes | Linux | NCCL | NVIDIA CUDA | Prometheus | Python | Quantization | Rate Limiting | RoCE | Slurm | TensorRT | TensorRT-LLM | Triton | VLLM | Volcano
Education
N/A
Related jobs
-
Apache Flink | Apache Iceberg | Apache Spark | CI/CD | DockerEntry-level Full TimeShanghai R1d ago
-
CI/CD | Docker | Flink | Go | IcebergEntry-level Full TimeShanghai R1d ago
-
Apache Flink | Apache Iceberg | Apache Spark | CI/CD | DockerSenior-level Full TimeShanghai R1d ago
-
Avp, Mgoc Tno Analytics, Gra CNY 300K-420KApplication development | Dash | Data Analysis | Data Visualization | DocumentationContinuous professional development | Flexible working | Inclusive work environmentExecutive-level Full TimeGuangzhou, Guangdong, China R4d ago
-
Senior Backend JavaScript Developer CNY 240K-480KAWS S3 | AWS SQS | Asynchronous processing | Backpressure | Data ModelingOn-call rotationSenior-level Full TimeBeijing, CN R7d ago
-
Senior Software Engineer (GenAI Agent platform) CNY 160K-240KEvaluation methods | Function Calling | Go | Integration Patterns | JavaSenior-level Full TimeGuangzhou, Guangdong, China R8d ago
-
Senior Consultant Specialist（GenAI Agent platform） CNY 160K-240KAWS | Access Management | Agentic Workflows | Audit Logging | AzureSenior-level Full TimeGuangzhou, Guangdong, China R8d ago
-
Technical Lead, Machine Learning CNY 144K-240KBias Evaluation | Cost Optimization | DPO | Data Pipelines | Evaluation PipelinesSenior-level Full TimeChina R10d ago
-
Staff Machine Learning Engineer CNY 144K-240KBias Evaluation | Cost Optimization | DPO | Data Pipelines | DeploymentSenior-level Full TimeChina R10d ago
-
Senior Software Engineer (RAG Backend Developer) CNY 277K-370KA/B | A/B Testing | ABAC | Access Control | Audit LoggingSenior-level Full TimeGuangzhou, Guangdong, China R11d ago
-
Alerting | Benchmarking | Data Pipelines | Distributed Systems | GPU ComputingMid-level Full TimeChina R14d ago
-
Mid-level Full TimeChina R14d ago
-
Entry-level Full TimeChina R15d ago
-
Principal Machine Learning Engineer CNY 144K-240KApache Arrow | Apache Spark | DPO | Deep learning | DeepSpeedSenior-level Full TimeChina R15d ago
-
Quantitative Developer (C++) HKD 300K-300KAlgorithms | C++ | Data Structures | High Frequency | High-Frequency TradingFree meals | Hybrid work | Paid time off | Social events | Volunteer opportunitiesMid-level Full TimeHong Kong, Shanghai R18d ago
-
自动驾驶系统开发高级/资深工程师（L4 Robotaxi） CNY 180K-300KActive Safety | Autonomous Driving | C++ | Control | End to EndMid-level Full Time广州 R21d ago
-
AWQ | AWS | Accelerate | Azure | BatchingSenior-level Full TimeGuangzhou, Guangdong, China R21d ago
-
Senior-level Full Time上海 R22d ago
-
Mid-level Full Time上海 R22d ago
-
Senior-level Full Time上海 R22d ago
-
Data Infra高级研发工程师（AI与具身智能数据平台方向） CNY 144K-240KAsynchronous processing | Automated testing | CI/CD | CRD | Cloud NativeSenior-level Full Time上海 R22d ago
-
Ego-Centric视觉感知算法工程师 CNY 180K-300K2D Segmentation | 3D Gaussian Splatting | 3D Hand Pose | 3D Reconstruction | 6D PoseMid-level Full Time上海、北京 R22d ago
-
数据算法开发工程师/专家 CNY 240K-480K2D Computer Vision | 3D Computer Vision | ASR | Ablation Study | Active LearningSenior-level Full Time上海 R22d ago
-
Consultant Specialist (GenAI Agent Platform) CNY 300K-420KAWS | Access Control | Agent Orchestration | Audit Logging | AzureEntry-level Full TimeGuangzhou, Guangdong, China R22d ago
-
APIs | AWS | Agent Orchestration | Agent systems | AzureMid-level Full TimeShenzhen, Guangdong, China R22d ago