AI工程师-Agent Infra & LLMOps 方向(武汉)
Tasks
- Build agent evaluation pipeline for ab testing
- Build agent tool server
- Containerize and maintain vector database middleware
- Create code execution sandbox with Docker or MicroVM
- Deploy fine tuned llm inference service
- Enforce cpu mem limits and network controls
- Generate and manage OpenAPI JSON Schema
- Implement serverless faas for agent tools
- Manage runtime dependencies for python and sql
- Optimize inference engine for low ttft
Perks/Benefits
- N/A
Skills/Tech-stack
AutoGPT | Docker | Firecracker | GRPC | GVisor | Go | HTTP2 | Inference Server | JSON Schema | Knative | Kubernetes | Langchain | Langsmith | MicroVM | Microservices | Milvus | Ollama | OpenAPI | OpenFaaS | Python | Qdrant | Serverless | TGI | TensorRT-LLM | Triton Inference | Triton Inference Server | VLLM
Education
Bachelor of Engineering | Bachelor of Science | Master of Science
Roles
AI | AI Engineer | DevOps | DevOps Engineer | Engineer | LLMOps Engineer
Related jobs
-
Bash | Data Ingestion | Data Processing | Docker | GCPAsynchronous work culture | Friendly laid-back atmosphereMid-level Full TimeShanghai, China8h ago
-
Computer Graphics | Computer Vision | CoreML | Deep learning | Diffusion ModelsSenior-level Full TimeBeijing, Beijing, China10h ago
-
CUDA | DeepSpeed | Distributed Training | FSDP | Gradient CheckpointingEntry-level Full TimeBeijing, Beijing, China11h ago
-
Entry-level Internship深圳18h ago
-
Entry-level InternshipBeijing,Beijing,China1d ago
-
(Sr) Cloud & Data Engineer CNY 192K-240KAWS | Automation | CI/CD | Container Security | Data ModelingMid-level Full TimeBeijing, Beijing, CN1d ago
-
[Growth Engineering] Staff Back-end Engineer I CNY 144K-240KAnomaly Detection | CI/CD | Containerization | FastAPI | Graph DatabaseSenior-level Full TimeShanghai, China1d ago
-
[Growth Engineering] Staff Back-end Engineer I CNY 144K-240KCI/CD | Containerization | FastAPI | Graph Database | Inference ServerSenior-level Full TimeShanghai, China1d ago
-
AI Development Intern CNY 28K-50KAlgorithm Development | Data Analysis | Machine Learning | PyTorch | PythonEntry-level InternshipBeijing,Beijing,China1d ago
-
C# | C++ | Computer Vision | Debugging | Deep learningSenior-level Full TimeChina, Shanghai1d ago
-
Entry-level Internship Part TimeShanghai - Daning Main Blg, China1d ago
-
Entry-level Full Time广州1d ago
-
Senior-level Full Time上海、北京1d ago
-
None Full Time淄博1d ago
-
None Full Time济南1d ago
-
【27届实习】Ai实习生(可转正) CNY 36K-48KAmazon Web Services | Computer Vision | Deep learning | Docker | KubernetesEntry-level Internship淄博、济南、青岛1d ago
-
Mid-level Full Time北京 R1d ago
-
A/B | A/B Experimentation | Autoscaling | Caching | Canary testingCommute subsidy | Disability insurance | Employee stock ownership | Generous vacation | Health insuranceSenior-level Full TimeShanghai, China2d ago
-
Apache Airflow | Apache Flink | Apache Spark | Automated testing | Data LakeCommute subsidy | Competitive retirement pension plans | Employee resource groups | Employee stock ownership | Generous vacation personal daysSenior-level Full TimeShanghai, China2d ago
-
Airflow | CUDA | Data Lake | Data Warehouse | FlinkCommute subsidy | Competitive retirement pension plans | Employee resource groups | Employee stock ownership | Generous vacation personal daysSenior-level Full TimeShanghai, China2d ago
-
A/B | A/B Testing | Autoscaling | B testing | Canary testingCommute subsidy | Competitive retirement pension plans | Employee resource groups | Employee stock ownership | Generous vacationSenior-level Full TimeShanghai, China2d ago
-
Senior Data Engineer, Content Management Systems (China) CNY 144K-240KAPI Integration | AWS | Access Control | Alibaba Cloud | CI/CDAnnual medical check-up | Flexible benefits | Long service award | Medical and life insurance | Paid time offSenior-level Full TimeChina - Shanghai2d ago
-
AWS | Apache Airflow | Apache Kafka | Apache Spark | AzureMid-level Full TimeCN-Shenzhen-HyQ, China2d ago
-
Entry-level Internship Part TimeShanghai (JingAn), China2d ago
-
Senior Data Engineer, Content Management Systems (China) CNY 144K-240KAPI Integration | AWS | Alibaba Cloud | Apache Kafka | Apache SparkAnnual Medical Checkup | Flexible benefits | Life insurance | Long service award | Medical insuranceSenior-level Full TimeChina - Shanghai2d ago