Engineering Manager, LLM Performance
US, CA, Santa Clara, United States
USD 224K-431K Mid-level Full Time
Tasks
- Accelerate LLM inference performance
- Design implement optimize inference features
- Develop production quality software libraries
- Improve inference performance on NVIDIA GPUs
- Integrate NVIDIA technologies for LLM deployment
- Lead and grow engineering team
- Plan projects deliver milestones coordinate cross functional teams
- Tune performance for key workloads using benchmarks
Perks/Benefits
Skills/Tech-stack
API Development | C++ | CUDA | Distributed Systems | GPU Architecture | Inference Optimization | Language Models | Large Language Models | Performance Tuning | Python | SGLang | Software Design | System Performance | System performance tuning | TensorRT | VLLM
Education
Regions
Countries
States
Cities
Related jobs
-
Featured Feat. Associate Director, Data Labs USD 167K-167KAWS | Cloud Computing | Compute Infrastructure | Data Analysis | LLM GovernanceConference speaking opportunities | Hybrid work schedule | Media appearancesSenior-level Full TimeWashington, District of Columbia, 20004, United … R25d ago
-
Senior Manager, Data Science USD 165K-256KA/B | A/B Testing | Ad Spend | Artificial Intelligence | Attribution401k matching | Disability insurance | Life insurance | Medical/Dental/Vision insurance | Paid Company HolidaysSenior-level Full TimeLocations: Redwood City, California, United States …7h ago
-
AWS | Agentic AI | Agile | Azure | Business IntelligenceDiscretionary incentive program | Hybrid work model | Mentorship | Professional developmentSenior-level Full TimeAustin, Texas, United States; Dallas, Texas, …7h ago
-
Project Lead Data Engineer III USD 119K-198KBTEQ | Database Administration | Patch Management | Performance Tuning | Query OptimizationSenior-level Full TimeSacramento, California, United States7h ago
-
Senior Manager, Data Science USD 142K-222KA/B | A/B Testing | Artificial Intelligence | B testing | Channel attributionCommunity health | Free games | Hybrid work schedule | Medical insurance | Mental health supportSenior-level Full Time地点：Redwood City, California, United States of …8h ago
-
Product Manager, Responsible AI Infra USD 163K-237KAI Evaluation | Artificial Intelligence | Automated compliance | Compliance | Data GovernanceMid-level Full TimeMountain View, CA, USA9h ago
-
Data Processing | Data orchestration | Data pipeline | Data pipeline management | Dataset ManagementExecutive-level Full TimeSan Jose, CA, USA9h ago
-
Software Engineering Manager II, AI/ML, Google Cloud USD 207K-301KC# | C++ | Cloud platform | Data Processing | DebuggingSenior-level Full TimeSunnyvale, CA, USA9h ago
-
Bigtable | C++ | Colossus | Data Processing | Data StorageSenior-level Full TimeMountain View, CA, USA9h ago
-
Senior Data Science Manager USD 160K-200KCausal Inference | Coded Quality | Data Pipelines | Data Visualization | Experiment designSenior-level Full TimeCupertino18h ago
-
Program Manager, AI & Data USD 125K-165KAgile | Amazon Web Services | Artificial Intelligence | Azure DevOps | Cloud platformMid-level Full TimeUS - Remote R23h ago
-
GenAI Account Manager USD 160K-205KAI Safety | Account Management | Communication | Consultative selling | Language ModelsCareer growth opportunities | Professional developmentMid-level Full TimeNew York, NY, US23h ago
-
Sr Engineering Program Manager, AIML Foundation Models USD 165K-293KCo-design | Cross-Functional Collaboration | Cross-functional | Data Pipelines | Distributed TrainingSenior-level Full TimeCupertino23h ago
-
API Design | Data Modeling | Distributed Systems | Low Latency | Low-Latency SystemsHybrid workMid-level Full TimeHQ-San Francisco23h ago
-
Manager-Data Science USD 90K-165KApache Hive | Big Data | ChatGPT | Data Mining | Decision TreesCareer development opportunities | Holistic wellbeing support | Learning opportunities | Visa sponsorshipMid-level Full TimeNew York, NY, United States1d ago
-
Senior ECAD Library & Engineering Data Engineer USD 160K-225K3D Component Models | APIs | Altium 365 | Altium Designer | Altium ScriptingOnsite collaborationSenior-level Full TimeSouth San Francisco, California, USA1d ago
-
Manager, Analytics and Market Research USD 137K-202KAgile | Data Analysis | Data Visualization | Dataiku | Machine Learning401k | Health insurance | Long-term incentive program | Paid time offMid-level Full TimeMettawa, IL, United States1d ago
-
Senior Manager, Oncology Payer and Channel Analytics USD 121K-202KClaims Analysis | Contracting strategy | Data Science | Dataiku | Formulary management401k | Dental insurance | Long-term incentive program | Medical insurance | Paid time offSenior-level Full TimeMettawa, IL, United States1d ago
-
Applied AI, Product Manager-Payments-Vice President USD 235K-285KAI orchestration | API Integration | Agentic Workflows | Agile delivery | Artificial IntelligenceBackup childcare | Equal opportunity employment | Financial coaching | Health care coverage | Mental health supportExecutive-level Full TimeBrooklyn, NY, United States1d ago
-
Manager, Media Experimentation & Incrementality USD 100K-160KBig Data | Causal Inference | Data Science | Difference-in-differences | Excel401k | Dental insurance | Discounts | Health insurance | Paid leaveMid-level Full TimeNew York, NEW YORK, United States1d ago
-
Financial Data and Analytics Manager USD 95K-142KArtificial Intelligence | Big Data | Big Data Integration | CRM | Data EngineeringHealthcare coverage | Retirement planMid-level Full TimeColumbia, Maryland, United States1d ago
-
AWS | Access Management | Active Active Resilience | Active/Active | AgileExecutive-level Full TimeJersey City, NJ, United States1d ago
-
Executive-level Full TimeUnited States1d ago
-
Mgr, Product Dev & Analytics USD 69K-75KAzure | Data Modeling | Databricks | Machine Learning | Model ValidationMid-level Full TimeAtlanta, GA, United States R1d ago
-
Director, Machine Learning - Search & Recommendation USD 211K-340KAPI Design | Data Integrity | Data Pipelines | Distributed Systems | Experimentation401k matching | Comprehensive medical coverage | Employee stock purchase plan | Paid parental leave | Unlimited PTOExecutive-level Full TimeAustin, Texas, United States; Chicago; Palo …1d ago