Senior Consultant Specialist (Model Hosting/Inference Optimization)
Guangzhou, GD, CN, 510620
CNY 120K-180K (estimate) Senior-level Full Time
Tasks
- Apply hardware specific optimizations
- Build and operate scalable model hosting platforms
- Build end to end fine tuning pipelines
- Deploy fine tuned models into hosting stack
- Integrate inference frameworks
- Monitor inference health and performance
- Optimize inference performance for latency throughput and cost
- Prepare datasets for fine tuning
- Run distributed training and hyperparameter tuning
- Troubleshoot deployment bottlenecks
Perks/Benefits
- N/A
Skills/Tech-stack
AWQ | AWS | Accelerate | Azure | Batching | CUDA | Distributed Training | Docker | FP8 | GCP | GPTQ | Hugging Face | Hugging Face Transformers | Hyperparameter Tuning | INT4) | KV cache | Kubernetes | LoRA | Python | QLoRA | Quantization | SGLang | TensorRT-LLM | VLLM
Education
Related jobs
-
Research MLE (Training Optimization）大模型训练优化工程师 CNY 144K-240KC++ | CUDA | DeepSpeed | Distributed Training | FSDPSenior-level Full TimeBeijing, Beijing, China8h ago
-
Senior-level Full TimeCN-OCG International Center, Cheng Du, China15h ago
-
Sr. Associate Director, Data and Analytics CNY 240K-360KAWS | Angular | Azure | Cloud platform | Google CloudMid-level Full TimeGuangzhou, GD, CN, 5106201d ago
-
Associate Director, Data and Analytics CNY 240K-360KAPI Testing | AWS | CI/CD | Cause analysis | Cloud TestingMid-level Full TimeGuangzhou, GD, CN, 5106201d ago
-
Sr. Associate Director, Data and Analytics CNY 240K-360KAmazon Web Services | Angular | Java | Jenkins pipeline | KubernetesMid-level Full TimeXi'an, SN, CN, -1d ago
-
Sr. Associate Director, Data and Analytics CNY 240K-360KAmazon Web Services | Angular | CI/CD | Java | JenkinsMid-level Full TimeGuangzhou, GD, CN, 5106201d ago
-
Ai算法工程师 CNY 144K-240KBig Data | Big data processing | Computer Vision | Data Analysis | Data ProcessingEntry-level Full Time深圳1d ago
-
【校招实习】Ai算法工程师 CNY 25K-37KComputer Vision | Data Analysis | Deep learning | Distributed Computing | Feature EngineeringInternship | Research and development experienceEntry-level Internship深圳1d ago
-
Entry-level Internship深圳1d ago
-
Ai算法暑期实习生（Llm/强化学习） CNY 37K-37KDPO | Deep learning | Fine Tuning | LLM Fine-tuning | Language ModelsAt least 2 months internship duration | Beijing internship location | Full-time internshipEntry-level Internship北京2d ago
-
Ai算法暑期实习生（Llm/强化学习） CNY 37K-37KDPO | Deep learning | Language Models | Large Language Models | Machine LearningFull-time internship | Internship 2 months or moreEntry-level Internship北京2d ago
-
视觉感知算法工程师 - 榫卯计划 CNY 96K-120K4D reconstruction | C++ | Camera | Computer Vision | Computer Vision DatasetsEntry-level Full Time深圳2d ago
-
数据开发工程师 CNY 144K-240KAPI Development | Airbyte | Apache Flink | Apache Kafka | Apache SparkAI tool subscription | API quota | Cloud credits | Fast execution | Flat organizationSenior-level Full Time深圳2d ago
-
Ai算法暑期实习生（Llm/强化学习） CNY 37K-37KDPO | Deep learning | Experimentation | Information Retrieval | Language ModelsContinuous internship 2 months or more | Full-time internship | Location BeijingEntry-level Internship北京2d ago
-
Ai 应用工程师实习生 CNY 36K-37KLangchain | Language Models | Large Language Models | Prompt engineering | PyTorchEntry-level Internship北京2d ago
-
Applied AI Engineer (Agents)-算法2组 CNY 144K-240KApp Development | Context engineering | Data Engineering | Evaluation | Fine TuningMid-level Full Time深圳、厦门2d ago
-
Mid-level Full TimeChina - Hong Kong3d ago
-
CUDA | DeepSpeed | Diffusion Models | Distributed Training | FSDPSenior-level Full TimeBeijing, Beijing, China3d ago
-
LLM Agent Research Scientist 大模型智能体研究科学家 CNY 144K-240KAgent systems | Benchmarking | Cloud Computing | DeepSpeed | GPU ComputingInternship opportunity | Open to all experience levelsEntry-level Full TimeBeijing, Beijing, China3d ago
-
DevOps Engineer CNY 240K-360KAWS | Alibaba Cloud | Ansible | Bamboo | CI/CDProfessional development opportunities | Smart casual dress code | Supportive work environmentSenior-level Full TimeShenzhen, Guangdong Sheng, China3d ago
-
Senior-level Full TimeChina, Shanghai3d ago
-
Deep Learning Compiler Engineer - CUDA CNY 144K-240KC# | C++ | CUDA | Computer Architecture | Distributed communicationComprehensive benefitsSenior-level Full TimeChina, Shanghai3d ago
-
Senior AI Engineer CNY 144K-240KCheckpointing | Distributed Training | Efficient Fine Tuning | Fine Tuning | GPU workload optimizationSenior-level Full TimeBeijing Yizhuang, China3d ago
-
Senior-level Full TimeCHN - Guangzhou - EMS, China3d ago
-
IT Developer Engineer (Phython+AI) CNY 300K-420KArtificial Intelligence | Code review | Debugging | Machine Learning | Production SupportFlexible work hours | In-person collaborationMid-level Full TimeCN004 - Shanghai, China (CN004)3d ago