Engineering Manager, LLM Performance
Tasks
- Design implement optimize LLM inference features
- Improve LLM inference performance on NVIDIA datacenter architectures
- Integrate NVIDIA technologies for developer experience
- Lead and grow engineering team for LLM inference performance
- Plan milestones and coordinate cross functional software delivery
- Tune inference performance for key workloads using benchmarks
Perks/Benefits
- N/A
Skills/Tech-stack
APIs | C++ | CUDA | GPU Architecture | LLM Inference | Language Models | Large Language Models | Performance Tuning | Python | SGLang | System Performance | System performance tuning | TensorRT-LLM | VLLM | Vision Language Models | Vision-language
Education
Roles
Regions
Countries
States
Related jobs
-
Product Manager, AI for Quantum USD 168K-258KAPIs | Artificial Intelligence | CUDA | GPU Computing | High PerformanceComprehensive benefits | EquityMid-level Full TimeUS, CA, Santa Clara R2d ago
-
Engineering Manager, Data Labeling Platform USD 200K-322KAuto-labeling | Data Lake | Data Pipelines | Data orchestration | Distributed SystemsEquity | Health benefits | Paid time offMid-level Full TimeUS, CA, Santa Clara R3d ago
-
Software Engineering Manager - Cloud Software, Data Platform & AI-Agentic Product Engineering USD 200K-215KAI | Call Management | Cloud Computing | Data platforms | Development Lifecycle401k | Dental insurance | Health insurance | Health savings account | Life insuranceMid-level Full TimeSanta Clara, CA R5d ago
-
Audio Understanding | Automatic Speech Recognition | Conversational AI | Cross-functional | Cross-functional Program ManagementCompany culture | Full benefits | Paid time offMid-level Full TimeSanta Clara, CA6d ago
-
AI analytics | APIs | Accrual | Agent-based | Agent-based systemsComprehensive benefits package | Equity | Family benefitsSenior-level Full TimeUS, CA, Santa Clara9d ago
-
Artificial Intelligence | Cross-Functional Coordination | Cross-functional | Data workflows | Logistics managementEquity | Health benefits | Paid time off | Relocation assistanceSenior-level Full TimeUS, CA, Santa Clara9d ago
-
Senior Product Manager – AI Inference Performance USD 208K-327KArtificial Intelligence | Benchmarking | Inference Optimization | Inference Server | KV cacheSenior-level Full TimeUS, CA, Santa Clara14d ago
-
Senior Developer Relations Manager, Data Platforms USD 224K-356KBusiness Development | Cloud Computing | Data Storage | Database technologies | Deep learningSenior-level Full TimeUS, CA, Santa Clara15d ago
-
CUDA-X | Data Annotation | Data Generation | Deep learning | Diffusion ModelsComprehensive benefits package | EquitySenior-level Full TimeUS, CA, Santa Clara17d ago
-
Accelerated computing | CUDA | Competitive Analysis | Data center | Data center architectureSenior-level Full TimeUS, CA, Santa Clara22d ago
-
Manager, GPU Accelerated Data Analytics USD 224K-431KAlgorithms | C# | C++ | CPU architecture | CUDASenior-level Full TimeUS, CA, Santa Clara R22d ago
-
Mid-level Full TimeUS, CA, Santa Clara R22d ago
-
Senior Product Manager - AI Platform Inference USD 168K-258KGPU Architecture | Generative AI | Go-to-market | Inference Optimization | Machine LearningEmployee benefits | EquitySenior-level Full TimeUS, CA, Santa Clara22d ago
-
Engineering Manager, AI Developer Technology USD 184K-356KC plus plus | CPU architecture | CUDA | Computer Architecture | Deep learningEmployee benefits | Equity | Hybrid workSenior-level Full TimeUS, CA, Santa Clara22d ago
-
Senior Engineering Manager, Object Storage - DGX Cloud USD 272K-431KAutomated testing | C++ | CI/CD | Call Management | Capacity PlanningSenior-level Full TimeUS, CA, Santa Clara R23d ago
-
Senior Technical Program Manager - Robotics USD 168K-258KAgile | Edge Deployment | Imitation Learning | Machine Learning | PythonSenior-level Full TimeUS, CA, Santa Clara27d ago
-
Mid-level Full TimeUS, CA, Santa Clara R30d ago
-
Machine Learning Engineering Manager, Evaluation, Agentic Search Capabilities, Proactive USD 174K-284KC++ | Data Curation | Data Generation | Data Quality | Data quality assessmentMid-level Full TimeSanta Clara1mo ago