llm服务部署工程师
Tasks
- Build LLM service CI CD pipeline
- Create standardized preprocessing training evaluation and deployment workflow for fine tune
- Develop edge LLM inference service pipeline
- Develop load testing backtesting accuracy troubleshooting and service call tools
- Implement model quantization and compilation optimizations
- Integrate and deploy LLM from pretrained model to edge inference service
- Integrate inference engines and run performance testing
- Optimize inference latency and memory usage on edge devices
- Package and version and deploy inference services
- Provide performance monitoring logging tracing and error diagnosis
Perks/Benefits
- N/A
Skills/Tech-stack
AWQ | Agent systems | As-a-Service | C++ | CI/CD | Eagle | Edge Computing | Fine Tuning | GPTQ | Gguf | Huggingface | INT4) | INT8 | Inference Optimization | Jetson Nano | Jetson Xavier | LoRA | Load Testing | Medusa | Model Compression | Model Quantization | Model-as-a-Service | Nano-LLM | Performance Testing | PyTorch | Python | QLoRA | RadixAttention | SGLang | Structured generation | Transformers | VLLM
Education
Regions
Countries
States
Related jobs
-
Principal Software Engineer(M365 Storage Fabric team) CNY 360K-510KAI-assisted engineering | AI-assisted engineering tools | Admission control | Automation | Autonomous Coding AgentsSenior-level Full TimeChina, Beijing, Beijing; China, Jiangsu, Suzhou; …9h ago
-
AI-assisted engineering | APIs | AWS | Algorithms | AutomationMid-level Full TimeChina, Beijing, Beijing; China, Jiangsu, Suzhou; …9h ago
-
Mid-level Full Time东莞1d ago
-
Mid-level Full Time深圳2d ago
-
Entry-level Full Time合肥2d ago
-
None Full Time上海2d ago
-
具身数据策略与质控工程师 CNY 25K-37KBenchmarking | Computer Vision | Data Quality | Data Quality Management | Data cleaningEntry-level Full Time北京2d ago
-
Mid-level Full Time北京2d ago
-
数据Infra工程师 (流式) CNY 180K-300KApache Spark | Automated Data Labeling | Data labeling | Data pipeline | Deep learningMid-level Full Time北京2d ago
-
数据Infra工程师 (具身) CNY 180K-300KApache Spark | Deep learning | Distributed Systems | Error Handling | FastAPIMid-level Full Time北京2d ago
-
Senior-level Full Time北京2d ago
-
Mid-level Full Time北京2d ago
-
Mid-level Full Time上海2d ago
-
Avp, Mgoc Tno Analytics, Gra CNY 300K-420KApplication development | Dash | Data Analysis | Data Visualization | DocumentationContinuous professional development | Flexible working | Inclusive work environmentExecutive-level Full TimeGuangzhou, Guangdong, China R3d ago
-
Principal Data Engineer Data Technology CNY 336K-510KAPIs | AWS | Apache Kafka | Apache Spark | CI/CDSenior-level Full TimeGuangzhou, Guangdong, China3d ago
-
Application Engineer - Associate CNY 25K-37KAgent workflows | Application development | Autogen | Git | LLM Application DevelopmentEntry-level Part TimeShanghai, China3d ago
-
Principal Data Engineer Data Technology CNY 336K-510KAPI Design | AWS | Apache Kafka | Apache Spark | Automated testingSenior-level Full TimeGuangzhou, GD, CN, 5106203d ago
-
Lead Data Scientist CNY 435K-510KAI Agents | AWS | Azure | CI/CD | Cloud ComputingHealthcare | Paid volunteering days | Retirement planning | Wellbeing initiativesSenior-level Full TimeCHN-Beijing-Zhong Guan Cun No.1, China3d ago
-
C# | C++ | CUDA | Computer Vision | GazeboCareer development | Hands-on experienceEntry-level Full TimeChina, Shanghai3d ago
-
Junior AI Full-Stack Engineer CNY 96K-144KAPI Development | Agent workflows | Audit Logging | Authorization | CachingEntry-level Full TimeSJ China Shanghai3d ago
-
Entry-level Internship北京3d ago
-
大模型预训练数据算法工程师 CNY 216K-360KAblation Study | Data Deduplication | Data Engineering | Data Filtering | Data ParsingMid-level Full Time北京、上海3d ago
-
Apache Flink | Apache Spark | Big Data | CI/CD | CassandraMid-level Full TimeShanghai3d ago
-
Analysis and Design | Big Data | Cassandra | Distillation | Distributed SystemsSenior-level Full TimeShanghai3d ago
-
Apache Flink | Apache Kafka | Apache Spark | Artificial Intelligence | CI/CDMid-level Full TimeShanghai3d ago