AI工程师-Agent Infra & LLMOps 方向(成都)
Tasks
- Build agent evaluation pipeline
- Build code execution sandbox
- Containerize and maintain vector databases
- Control network access for sandbox
- Deploy LLM inference services
- Design agent tool server
- Enforce CPU and memory isolation
- Generate OpenAPI and JSON Schema
- Implement serverless functions
- Manage dependencies for generated code
- Optimize inference engines
- Reduce time to first token latency
- Run A B evaluation scripts on cluster
Perks/Benefits
- N/A
Skills/Tech-stack
Access Control | AutoGPT | CPU isolation | Docker | Firecracker | GRPC | GVisor | Go | HTTP2 | Inference Server | JSON Schema | Knative | Kubernetes | Langchain | Memory isolation | MicroVM | Milvus | Network Access | Network Access Control | Ollama | OpenAPI | OpenFaaS | Process Isolation | Python | Qdrant | Serverless | TensorRT-LLM | Triton Inference | Triton Inference Server | VLLM
Education
Bachelor of Engineering | Bachelor of Science | Master of Science | PhD
Roles
AI | AI Engineer | DevOps | DevOps Engineer | Engineer | LLM Engineer | Platform | Platform Engineer
Related jobs
-
Bash | Data Ingestion | Data Processing | Docker | GCPAsynchronous work culture | Friendly laid-back atmosphereMid-level Full TimeShanghai, China8h ago
-
Computer Graphics | Computer Vision | CoreML | Deep learning | Diffusion ModelsSenior-level Full TimeBeijing, Beijing, China11h ago
-
CUDA | DeepSpeed | Distributed Training | FSDP | Gradient CheckpointingEntry-level Full TimeBeijing, Beijing, China11h ago
-
Entry-level Internship深圳18h ago
-
Entry-level InternshipBeijing,Beijing,China1d ago
-
(Sr) Cloud & Data Engineer CNY 192K-240KAWS | Automation | CI/CD | Container Security | Data ModelingMid-level Full TimeBeijing, Beijing, CN1d ago
-
[Growth Engineering] Staff Back-end Engineer I CNY 144K-240KAnomaly Detection | CI/CD | Containerization | FastAPI | Graph DatabaseSenior-level Full TimeShanghai, China1d ago
-
[Growth Engineering] Staff Back-end Engineer I CNY 144K-240KCI/CD | Containerization | FastAPI | Graph Database | Inference ServerSenior-level Full TimeShanghai, China1d ago
-
AI Development Intern CNY 28K-50KAlgorithm Development | Data Analysis | Machine Learning | PyTorch | PythonEntry-level InternshipBeijing,Beijing,China1d ago
-
C# | C++ | Computer Vision | Debugging | Deep learningSenior-level Full TimeChina, Shanghai1d ago
-
Entry-level Internship Part TimeShanghai - Daning Main Blg, China1d ago
-
Entry-level Full Time广州1d ago
-
Senior-level Full Time上海、北京1d ago
-
None Full Time淄博1d ago
-
None Full Time济南1d ago
-
【27届实习】Ai实习生(可转正) CNY 36K-48KAmazon Web Services | Computer Vision | Deep learning | Docker | KubernetesEntry-level Internship淄博、济南、青岛1d ago
-
Mid-level Full Time北京 R1d ago
-
A/B | A/B Experimentation | Autoscaling | Caching | Canary testingCommute subsidy | Disability insurance | Employee stock ownership | Generous vacation | Health insuranceSenior-level Full TimeShanghai, China2d ago
-
Apache Airflow | Apache Flink | Apache Spark | Automated testing | Data LakeCommute subsidy | Competitive retirement pension plans | Employee resource groups | Employee stock ownership | Generous vacation personal daysSenior-level Full TimeShanghai, China2d ago
-
Airflow | CUDA | Data Lake | Data Warehouse | FlinkCommute subsidy | Competitive retirement pension plans | Employee resource groups | Employee stock ownership | Generous vacation personal daysSenior-level Full TimeShanghai, China2d ago
-
A/B | A/B Testing | Autoscaling | B testing | Canary testingCommute subsidy | Competitive retirement pension plans | Employee resource groups | Employee stock ownership | Generous vacationSenior-level Full TimeShanghai, China2d ago
-
Senior Data Engineer, Content Management Systems (China) CNY 144K-240KAPI Integration | AWS | Access Control | Alibaba Cloud | CI/CDAnnual medical check-up | Flexible benefits | Long service award | Medical and life insurance | Paid time offSenior-level Full TimeChina - Shanghai2d ago
-
AWS | Apache Airflow | Apache Kafka | Apache Spark | AzureMid-level Full TimeCN-Shenzhen-HyQ, China2d ago
-
Entry-level Internship Part TimeShanghai (JingAn), China2d ago
-
Senior Data Engineer, Content Management Systems (China) CNY 144K-240KAPI Integration | AWS | Alibaba Cloud | Apache Kafka | Apache SparkAnnual Medical Checkup | Flexible benefits | Life insurance | Long service award | Medical insuranceSenior-level Full TimeChina - Shanghai2d ago