AI运维工程师(大模型推理 / AI Infra)
Tasks
- Automate operations and maintenance
- Build AI infrastructure
- Conduct model quantization and inference acceleration
- Deploy inference frameworks
- Deploy large model inference services
- Ensure inference stability and reliability
- Implement Kubernetes deployments
- Implement containerized services
- Increase inference throughput
- Manage GPU cluster operations
- Operate and maintain inference services
- Optimize GPU memory utilization
- Optimize inference performance
- Run load testing and troubleshooting
- Set up monitoring and alerting
- Support model rollout and online stability optimization
Perks/Benefits
- N/A
Skills/Tech-stack
Docker | GPU Cluster | GPU Memory Optimization | GPU memory | Inference acceleration | Kubernetes | Linux | Lmdeploy | Memory Optimization | Model Quantization | Monitoring and Alerting | Python | Shell | TGI | TensorRT-LLM | Throughput Optimization | Transformer | VLLM
Education
Related jobs
-
Ai算法工程师 CNY 144K-240KApache Hadoop | Apache Hive | Apache Spark | Deep learning | Feature EngineeringEntry-level Full Time深圳23h ago
-
Senior AI Operations Engineer CNY 144K-240KAlert Correlation | Docker | Forecasting | Function Calling | KubernetesSenior-level Full TimeChina, China2d ago
-
Consultant Specialist CNY 144K-184KAlibaba Cloud | CI/CD | Cloud deployment | Cloud platform | ContainerizationSenior-level Full TimeXi'an, Shaanxi, China2d ago
-
Computer Vision | CoreML | Diffusion Models | GLSL | Geometric processingSenior-level Full TimeBeijing, China2d ago
-
Agentic Engineering | Apache Airflow | Apache NiFi | Automated testing | BigQueryMid-level Full TimeGuangzhou, Guangdong, China2d ago
-
Senior Consultant Specialist(GenAI Agent platform) CNY 160K-240KAWS | Access Management | Agent Orchestration | Audit Logging | AzureSenior-level Full TimeGuangzhou, Guangdong, China R2d ago
-
Apache Airflow | Apache Kafka | Apache NiFi | Automated testing | BigQueryMid-level Full TimeGuangzhou, GD, CN, 5106202d ago
-
Consultant Specialist CNY 144K-184KAlibaba Cloud | CI/CD | Containerization | Cost Optimization | Data GovernanceSenior-level Full TimeXi'an, SN, CN, -2d ago
-
Mid-level Full TimeBJN01 - DXC Beijing LSH Center …2d ago
-
Mid-level Full TimeShanghai Jing'An Office, China2d ago
-
Mid-level Full TimeChina Shanghai2d ago
-
Mid-level Full TimeChina Shanghai2d ago
-
3D Reconstruction | Accuracy Metrics | C++ | Camera Calibration | Cloud processingSenior-level Full TimeSuzhou, China2d ago
-
腾讯云数据迁移工程师 CNY 144K-240KAWS | Azure | CI/CD | CloudFormation | Data GovernanceFlexible work arrangements | In-person collaborationMid-level Full TimeSHC01 - DXC Shanghai Campus Phase …2d ago
-
数据平台开发工程师 CNY 180K-300KData Lake | Data Warehouse | Data Warehouse Modeling | Data pipeline | DataOpsMid-level Full Time广州2d ago
-
Quantitative Researcher (AI Direction) CNY 144K-240KAlpha generation | Deep learning | High Frequency | High-Frequency Trading | JAXCareer development opportunities | Casual working environment | Digital asset market exposure | Meritocratic cultureSenior-level Full TimeShanghai3d ago
-
Senior Software Engineer (GenAI Agent platform) CNY 160K-240KGo | Java | Langchain | Langgraph | PythonSenior-level Full TimeGuangzhou, Guangdong, China R3d ago
-
Biomedical Data | Data Governance | Data Mining | Data Pipelines | Data QualityMid-level Full TimeSuzhou3d ago
-
AI Data Scientist Intern CNY 38K-50KAI Algorithms | Data Annotation | Data Integrity | Data Modeling | Data QualityOnsite work at company facilitiesEntry-level Internship Part TimeShanghai - Daning A2 PIC, China3d ago
-
Mid-level Full TimeShanghai, China3d ago
-
Senior Machine Learning Engineer CNY 400K-510K3D Reconstruction | Adversarial Networks | C++ | Computer Graphics | Computer VisionSenior-level Full TimeShanghai, China3d ago
-
Sr. IT Specialist,AI. CNY 240K-480K.Net Core | AI Search | Agent Framework | Agent systems | AutogenSenior-level Full TimeShanghai, China3d ago
-
Mid-level Full TimeCN-OCG International Center, Cheng Du, China3d ago
-
Mid-level Full TimeCN-OCG International Center, Cheng Du, China3d ago
-
Senior-level Full TimeShanghai3d ago