aijobs.net

Sign in

Engineering Manager, LLM Performance

US, CA, Santa Clara

USD 224K-431K Mid-level Full Time

Apply Save

Found 4d ago

Tasks

Design implement optimize LLM inference features
Develop software for LLM deployment and developer experience
Improve LLM inference performance on NVIDIA datacenter architectures
Lead team for LLM inference performance
Plan projects deliver milestones coordinate cross functional teams
Tune performance using inference benchmarks

Perks/Benefits

N/A

Skills/Tech-stack

API Development | C++ | CUDA | GPU Architecture | LLM Inference | Performance Tuning | Python | SGLang | System Performance | System performance tuning | TensorRT-LLM | VLLM

Education

Master of Science | PhD

Roles

Engineering | Engineering Manager | Manager

Regions

Countries

States

Villa Clara Province, CU

Cities

Santa Clara, Villa Clara Province, CU

Apply Save

Language: en Views:

0 Clicks:

0 Saves: 0

Related jobs

Senior Product Manager - Agentic Data Analytics USD 208K-379K

CPU GPU | CPU GPU Tradeoffs | Cost estimation | Data Governance | Data analytics

Senior-level Full Time

US, CA, Santa Clara R

2d ago
Senior Manager, Software Development - GPU Accelerated Storage USD 248K-442K

C plus plus | CUDA | DMA Buffer | Databases | Drivers

Senior-level Full Time

US, CA, Santa Clara

8d ago
Senior Manager, Engineering - AI Developer Tools USD 272K-431K

Agile | Automation | Go | JavaScript | Python

Senior-level Full Time

US, CA, Santa Clara R

11d ago
Manager, Next-Gen AI Cluster Validation USD 224K-356K

Ansible | Cluster architecture | Deep learning | Distributed Systems | Go

Mid-level Full Time

US, CA, Santa Clara R

13d ago