Senior Consultant Specialist (Model Hosting/Inference Optimization)
Xi'an, Shaanxi, China
R
CNY 160K-192K (estimate) Senior-level Full Time
Tasks
- Apply hardware specific performance optimizations
- Benchmark and validate fine tuned models
- Build model hosting platforms for LLMs and speech models
- Deploy hosted models on container platforms
- Implement fine tuning pipelines for foundation models
- Integrate inference frameworks into production systems
- Monitor inference health and performance
- Optimize inference latency throughput and cost
- Troubleshoot deployment bottlenecks
Perks/Benefits
- N/A
Skills/Tech-stack
AWQ | AWS | Accelerate | Azure | CPU architecture | CUDA | Continuous batching | Cost Optimization | Data Preparation | Distributed Training | Docker | Dockerized Deployment | Dynamic batching | FP8 | GPTQ | GPU Architecture | Google Cloud | HPC | Hugging Face | Hugging Face Transformers | Hyperparameter Tuning | INT4) | Inference Optimization | KV cache | Kubernetes | Latency optimization | LoRA | Operator optimization | Python | QLoRA | Quantization | SGLang | TensorRT-LLM | Throughput Optimization | VLLM
Education
Related jobs
-
Machine Learning Engineer, Infra (MLOps) CNY 435K-540KAirflow | Apache Spark | Automated testing | CI/CD | Dataset ManagementMid-level Full TimeBeijing, China [Hybrid] R17h ago
-
Principal Data Engineer, Data Technology CNY 300K-420KAPI Development | AWS | Apache Spark | CI/CD | Cloud platformSenior-level Full TimeGuangzhou, Guangdong, China R1d ago
-
Mid-level Full TimeChina R5d ago
-
Principal Software Engineer, AI Email App CNY 480K-540KAPI Design | Backend Engineering | Code Reviews | Design reviews | Desktop DevelopmentSenior-level Full TimeChina R5d ago
-
Lead Software Engineer, AI Email App CNY 460K-540KAPI Design | Backend Development | Code review | Cost Optimization | Design reviewSenior-level Full TimeChina R5d ago
-
Staff Software Engineer, AI Email App CNY 435K-510KAPI Design | Backend Development | Cost Optimization | Desktop Development | Distributed SystemsSenior-level Full TimeChina R5d ago
-
Lead Engineer, Machine Learning CNY 360K-500KCost Optimization | Data Pipelines | Fine Tuning | GPU Optimization | Inference SystemsSenior-level Full TimeChina R5d ago
-
AWS | Agent Orchestration | Agent systems | Azure | Cloud platformMid-level Full TimeShenzhen, Guangdong, China R5d ago
-
Apache Flink | Apache Iceberg | Apache Spark | CI/CD | DockerMid-level Full TimeShanghai R7d ago
-
Apache Flink | Apache Iceberg | Apache Spark | CI/CD | DatabasesMid-level Full TimeShanghai R7d ago
-
Senior AI Data Infrastructure Engineer CNY 144K-240KAlerting | CI/CD | Caching | Cloud Object Storage | Data Lakes401k plan | Comprehensive office equipment | Flexible work environment | Health, dental, vision insurance | Remote work optionsSenior-level Full TimeShanghai R7d ago
-
Apache Flink | Apache Iceberg | Apache Spark | CI/CD | DockerEntry-level Full TimeShanghai R7d ago
-
CI/CD | Docker | Flink | Go | IcebergEntry-level Full TimeShanghai R7d ago
-
Apache Flink | Apache Iceberg | Apache Spark | CI/CD | DockerSenior-level Full TimeShanghai R7d ago
-
Avp, Mgoc Tno Analytics, Gra CNY 300K-420KApplication development | Dash | Data Analysis | Data Visualization | DocumentationContinuous professional development | Flexible working | Inclusive work environmentExecutive-level Full TimeGuangzhou, Guangdong, China R11d ago
-
Senior Backend JavaScript Developer CNY 240K-480KAWS S3 | AWS SQS | Asynchronous processing | Backpressure | Data ModelingOn-call rotationSenior-level Full TimeBeijing, CN R14d ago
-
Technical Lead, Machine Learning CNY 144K-240KBias Evaluation | Cost Optimization | DPO | Data Pipelines | Evaluation PipelinesSenior-level Full TimeChina R17d ago
-
Staff Machine Learning Engineer CNY 144K-240KBias Evaluation | Cost Optimization | DPO | Data Pipelines | DeploymentSenior-level Full TimeChina R17d ago
-
Alerting | Benchmarking | Data Pipelines | Distributed Systems | GPU ComputingMid-level Full TimeChina R21d ago
-
Mid-level Full TimeChina R21d ago
-
Entry-level Full TimeChina R22d ago
-
Principal Machine Learning Engineer CNY 144K-240KApache Arrow | Apache Spark | DPO | Deep learning | DeepSpeedSenior-level Full TimeChina R22d ago
-
Quantitative Developer (C++) HKD 300K-300KAlgorithms | C++ | Data Structures | High Frequency | High-Frequency TradingFree meals | Hybrid work | Paid time off | Social events | Volunteer opportunitiesMid-level Full TimeHong Kong, Shanghai R25d ago
-
Mid-level Full Time惠州 R27d ago
-
自动驾驶系统开发高级/资深工程师（L4 Robotaxi） CNY 180K-300KActive Safety | Autonomous Driving | C++ | Control | End to EndMid-level Full Time广州 R28d ago