aijobs.net

Sign in

Manager, Large Language Model Inference

US, CA, Santa Clara R

USD 184K-356K Mid-level Full Time

Apply Save

Found 1d ago

Tasks

Coordinate cross-functional teams
Design production inference software
Develop LLM inference runtime software
Integrate NVIDIA technologies
Lead engineering team
Optimize inference kernels
Plan projects and deliver milestones
Provide developer experience for LLM deployment

Perks/Benefits

Skills/Tech-stack

API Development | C++ | CUDA | GPU Architecture | Python | SGLang | TensorRT | TensorRT-LLM | VLLM

Education

Master of Science | PhD

Roles

Engineering | Engineering Manager | Manager

Regions

Countries

States

Villa Clara Province, CU

Cities

Santa Clara, Villa Clara Province, CU

Apply Save

Language: en Views: 0

Clicks: 0

Saves: 0

Related jobs

Manager, GPU Accelerated Data Analytics USD 224K-431K

Algorithms | C# | C++ | CPU architecture | CUDA

Senior-level Full Time

US, CA, Santa Clara R

1d ago
Engineering Manager, Deep Learning Inference USD 184K-287K

Agile | C# | C++ | CUDA | Cutlass

Mid-level Full Time

US, CA, Santa Clara R

1d ago
Senior Engineering Manager, Object Storage - DGX Cloud USD 272K-431K

Automated testing | C++ | CI/CD | Call Management | Capacity Planning

Senior-level Full Time

US, CA, Santa Clara R

2d ago
Engineering Manager, Deep Learning Inference USD 224K-431K

Agile | C# | C++ | CUDA | Cutlass

Mid-level Full Time

US, CA, Santa Clara R

9d ago