AI工程师-Agent Infra & LLMOps 方向（武汉）
Tasks
- Build agent evaluation pipeline for ab testing
- Build agent tool server
- Containerize and maintain vector database middleware
- Create code execution sandbox with Docker or MicroVM
- Deploy fine tuned llm inference service
- Enforce cpu mem limits and network controls
- Generate and manage OpenAPI JSON Schema
- Implement serverless faas for agent tools
- Manage runtime dependencies for python and sql
- Optimize inference engine for low ttft
Perks/Benefits
- N/A
Skills/Tech-stack
AutoGPT | Docker | Firecracker | GRPC | GVisor | Go | HTTP2 | Inference Server | JSON Schema | Knative | Kubernetes | Langchain | Langsmith | MicroVM | Microservices | Milvus | Ollama | OpenAPI | OpenFaaS | Python | Qdrant | Serverless | TGI | TensorRT-LLM | Triton Inference | Triton Inference Server | VLLM
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Roles
AI | AI Engineer | DevOps | DevOps Engineer | Engineer | LLMOps Engineer
Related jobs
-
Associate Director, Data and Analytics Specialist CNY 240K-360KAgile | Ansible | Apache Spark | Bamboo | BitbucketMid-level Full TimeXi'an, Shaanxi, China10h ago
-
Analyst, Data Science CNY 144K-240KApplication Integration | Debugging | Documentation | Java | JavaScriptSenior-level Full TimeCN-M Plaza, China20h ago
-
Principal Perception Engineer CNY 360K-600KC++ | Knowledge Distillation | Model Conversion | Model Pruning | Network CompressionSenior-level Full Time5-8F TOWER C, 788 JINZHONG ROAD, …20h ago
-
Senior Specialist, AI Application CNY 360K-600KAgile | Angular | Cloud Platforms | Generative AI | JavaSenior-level Full TimeCN-OCG International Center, Cheng Du, China20h ago
-
Senior-level Full TimeCN-OCG International Center, Cheng Du, China20h ago
-
Behavior Cloning | C++ | Cloud processing | Control | DaggerEntry-level Internship北京、上海 R21h ago
-
Entry-level Internship上海21h ago
-
Entry-level Full Time深圳、北京、上海23h ago
-
Entry-level Full Time深圳、上海23h ago
-
大语言模型后训练算法工程师 CNY 240K-480KDistributed Training | Docker | Evaluation metrics | Fine Tuning | KubernetesMid-level Full Time深圳、上海23h ago
-
Senior-level Full Time广州23h ago
-
Mid-level Full Time上海1d ago
-
Mid-level Full Time北京 R1d ago
-
Entry-level Internship北京1d ago
-
Entry-level Full Time上海1d ago
-
Entry-level Full Time上海1d ago
-
Avp - Data And Analytics CNY 300K-420KAWS | BigQuery | Cloud Computing | Cloud platform | Customer SegmentationCareer growth opportunities | Flexible working | Inclusive work environment | Professional developmentExecutive-level Full TimeGuangzhou, Guangdong, China R1d ago
-
AI Intern - LLM CNY 25K-37KData Annotation | Fine Tuning | Langchain | Language Processing | Machine LearningEntry-level Full Time InternshipBeijing, Beijing, China1d ago
-
AI/ML Scientist CNY 300K-420KAPI Development | Computer Vision | Data Analysis | Data Modeling | Data PreprocessingEntry-level Full TimeCNSGH18 - Shanghai - No. 757 …1d ago
-
Data Analysis Engineer-AI CNY 192K-300KAmazon Web Services | Apache Spark | Big Data | Data Analysis | Data MiningSenior-level Full TimeCQM01 - CQM01, Chongqing Software Park, …1d ago
-
Data Analysis Engineer CNY 300K-420KAlgorithms | Amazon Web Services | Apache Spark | Big Data | Data MiningMid-level Full TimeCQM01 - CQM01, Chongqing Software Park, …1d ago
-
大模型算法实习生 CNY 36K-37KDeep learning | DeepSpeed | Distributed Training | Java | Machine LearningCollaborative team | Large NLP dataset access | Long term internship support | Technical mentorship | Technical resourcesEntry-level Internship北京、上海2d ago
-
Mid-level Full Time北京2d ago
-
Entry-level Full Time北京、广州、上海2d ago
-
Computer Vision | Computer Vision Analytics | Data Annotation | Data Engineering | Data PipelinesSenior-level Full TimeSuzhou, China2d ago