Engineering Manager, LLM Performance
Tasks
- Design implement optimize LLM inference features
- Develop software for LLM deployment and developer experience
- Improve LLM inference performance on NVIDIA datacenter architectures
- Lead team for LLM inference performance
- Plan projects deliver milestones coordinate cross functional teams
- Tune performance using inference benchmarks
Perks/Benefits
- N/A
Skills/Tech-stack
API Development | C++ | CUDA | GPU Architecture | LLM Inference | Performance Tuning | Python | SGLang | System Performance | System performance tuning | TensorRT-LLM | VLLM
Education
Roles
Regions
Countries
States
Related jobs
-
Machine Learning Engineering Manager, Evaluation, Agentic Search Capabilities, Proactive USD 174K-284KC++ | Data Curation | Data Generation | Data Quality | Data quality assessmentMid-level Full TimeSanta Clara1d ago
-
Senior Engineering Manager, Object Storage - DGX Cloud USD 272K-488KAI infrastructure | Automated testing | C++ | CI/CD | Call ManagementBenefits | Equity | Learning opportunitiesSenior-level Full TimeUS, CA, Santa Clara R8d ago
-
APIs | C plus plus | CUDA | Computer Vision | Control TheorySenior-level Full TimeUS, CA, Santa Clara12d ago
-
Manager, Deep Learning Algorithms USD 224K-431KDebugging | Deep learning | GPU Computing | Inference Optimization | JiraConference participation | Customer site visits | Equity | Travel opportunitiesMid-level Full TimeUS, CA, Santa Clara14d ago
-
Manager, Software Engineering - Production AI Inference USD 224K-431KAI | Automation | CUBLAS | CUDA | CUDNNMid-level Full TimeUS, CA, Santa Clara19d ago
-
Senior Product Manager - Agentic Data Analytics USD 208K-379KCost estimation | Data Governance | Databases | Distributed Systems | Evaluation datasetsBenefits | EquitySenior-level Full TimeUS, CA, Santa Clara R20d ago
-
Senior Manager, Engineering - AI Developer Tools USD 272K-431KAgile | Automation | Go | JavaScript | PythonSenior-level Full TimeUS, CA, Santa Clara R1mo ago