Engineering Manager, LLM Performance
Tasks
- Design implement optimize LLM inference features
- Improve LLM inference performance on NVIDIA datacenter architectures
- Integrate NVIDIA technologies for developer experience
- Lead and grow engineering team for LLM inference performance
- Plan milestones and coordinate cross functional software delivery
- Tune inference performance for key workloads using benchmarks
Perks/Benefits
- N/A
Skills/Tech-stack
APIs | C++ | CUDA | GPU Architecture | LLM Inference | Language Models | Large Language Models | Performance Tuning | Python | SGLang | System Performance | System performance tuning | TensorRT-LLM | VLLM | Vision Language Models | Vision-language
Education
Roles
Regions
Countries
States
Related jobs
-
Autonomous Vehicles | Cosmos | Data Curation | Data Generation | Deep learningSenior-level Full TimeUS, CA, Santa Clara R1d ago
-
Accelerated computing | CUDA | Competitive Analysis | Data center | Data center architectureSenior-level Full TimeUS, CA, Santa Clara1d ago
-
Manager, GPU Accelerated Data Analytics USD 224K-431KAlgorithms | C# | C++ | CPU architecture | CUDASenior-level Full TimeUS, CA, Santa Clara R1d ago
-
Mid-level Full TimeUS, CA, Santa Clara R1d ago
-
Manager, Large Language Model Inference USD 184K-356KAPI Development | C++ | CUDA | GPU Architecture | PythonEquity | Flexible work options | Health insurance | Paid time offMid-level Full TimeUS, CA, Santa Clara R1d ago
-
Senior Product Manager - AI Platform Inference USD 168K-258KGPU Architecture | Generative AI | Go-to-market | Inference Optimization | Machine LearningEmployee benefits | EquitySenior-level Full TimeUS, CA, Santa Clara1d ago
-
Engineering Manager, AI Developer Technology USD 184K-356KC plus plus | CPU architecture | CUDA | Computer Architecture | Deep learningEmployee benefits | Equity | Hybrid workSenior-level Full TimeUS, CA, Santa Clara1d ago
-
Senior Engineering Manager, Object Storage - DGX Cloud USD 272K-431KAutomated testing | C++ | CI/CD | Call Management | Capacity PlanningSenior-level Full TimeUS, CA, Santa Clara R2d ago
-
Senior Technical Program Manager - Robotics USD 168K-258KAgile | Edge Deployment | Imitation Learning | Machine Learning | PythonSenior-level Full TimeUS, CA, Santa Clara6d ago
-
Manager, Data and AI Engineering USD 200K-322KAI Agents | API Design | API Gateway | AWS | AWS LambdaBenefits | EquityMid-level Full TimeUS, CA, Santa Clara8d ago
-
Mid-level Full TimeUS, CA, Santa Clara R9d ago
-
Machine Learning Engineering Manager, Evaluation, Agentic Search Capabilities, Proactive USD 174K-284KC++ | Data Curation | Data Generation | Data Quality | Data quality assessmentMid-level Full TimeSanta Clara17d ago