Engineering Manager, LLM Performance
US, CA, Santa Clara, United States
USD 224K-431K Mid-level Full Time
Tasks
- Accelerate LLM inference performance
- Design implement optimize inference features
- Develop production quality software libraries
- Improve inference performance on NVIDIA GPUs
- Integrate NVIDIA technologies for LLM deployment
- Lead and grow engineering team
- Plan projects deliver milestones coordinate cross functional teams
- Tune performance for key workloads using benchmarks
Perks/Benefits
Skills/Tech-stack
API Development | C++ | CUDA | Distributed Systems | GPU Architecture | Inference Optimization | Language Models | Large Language Models | Performance Tuning | Python | SGLang | Software Design | System Performance | System performance tuning | TensorRT | VLLM
Education
Regions
Countries
States
Cities
Related jobs
-
Launch Manager, Google Play Trust and Safety USD 129K-191KAI Classifiers | Anti-abuse | Artificial Intelligence | Content Moderation | Content policyMid-level Full TimeKirkland, WA, USA; Austin, TX, USA16h ago
-
Director, Oncology Commercial Data Science & AI Products USD 186K-279KAgent Orchestration | Agentic AI | Claims data | Data Governance | EHRExecutive-level Full TimeUS - Gaithersburg - MD, United …1d ago
-
A/B | A/B Testing | Agile | Azure DevOps | B testingHybrid work 2 to 3 days per week | On site presence options Palo Alto Seattle BethesdaSenior-level Full TimeMD Bethesda Office, United States R1d ago
-
Product Manager, Applied AI (Staff / Senior Staff) USD 230K-300KAgentic Systems | Artificial Intelligence | Data Flywheel | Data Modeling | Error Analysis401k savings plan | Commuter benefits | Daily in-office meals | Healthcare FSA | Healthcare coverageSenior-level Full TimeNew York City, NY R1d ago
-
VP Software Engineering, Robotics & System USD 250K-320KAI machine learning | Cloud Computing | Cloud Integrated Hardware Software Systems | Cloud systems | Code review401k match | Dental insurance | Health insurance | Paid Medical Dental Vision Coverage | Pre-tax commuter benefitsExecutive-level Full TimeSan Francisco1d ago
-
Architecture Review | Compiler design | Data Stores | Database engines | Distributed Systems401k matching | Hybrid work arrangement | Life insurance | Long-term disability | Medical, dental, and vision insuranceSenior-level Full TimeSan Jose, California, United States of … R2d ago
-
Senior-level Full TimeBoston R2d ago
-
Sr. Manager, Business Analytics & Strategy USD 150K-200KCPQ | Customer Relationship Management | Customer relationship | Dashboards | Data AnalysisDental insurance | Educational assistance | Flexible spending account | Health insurance | Health savings accountSenior-level Full TimeLisle, Illinois2d ago
-
Software Engineering Manager, Core USD 207K-300KAI Agent | AI Agent Frameworks | Agent Frameworks | Cilium | Cloud SecuritySenior-level Full TimeNew York, NY, USA2d ago
-
C# | C++ | Computer Vision | Data Processing | DebuggingSenior-level Full TimeNew York, NY, USA; Sunnyvale, CA, …2d ago
-
Product Manager, Geo Auto Data Platform USD 192K-278KAdvanced driver assistance | Advanced driver assistance systems | Automated testing | Autonomous Driving | Autonomous Driving FeaturesSenior-level Full TimeSeattle, WA, USA; Mountain View, CA, …2d ago
-
C# | C++ | Code review | Computer Vision | Data ProcessingSenior-level Full TimeMountain View, CA, USA2d ago
-
Senior Manager Robotics Engineering USD 172K-258KArtificial Intelligence | Autonomous Vehicles | Autonomy stack | C++ | Computer Vision401k savings plan | Adoption benefits | Career development | Disability benefits | Domestic relocation assistanceSenior-level Full TimeIrving, Texas, United States3d ago
-
AI Fluency Education Lead USD 270K-365KAdult Learning | Content development | Curriculum Design | Instructional Design | Interactive learningSenior-level Full TimeSan Francisco, CA | New York … R3d ago
-
Applied AI Architect, Enterprise Tech USD 240K-315KAPI Integration | Cloud Architecture | Data Science | Enterprise Integration | LLM EvaluationFlexible working hours | Generous vacation | Hybrid work policy | Optional equity donation matching | Parental leaveSenior-level Full TimeSan Francisco, CA | New York … R3d ago
-
Data Pipelines | Data Synthesis | Dataset curation | Efficient Fine Tuning | ExperimentationMid-level Full TimeCupertino3d ago
-
Analytics | Process Improvement | Python | Reporting | SQLCommuter stipend | Comprehensive health, dental and vision coverage | Generous PTO | Learning and development stipend | Retirement benefitsMid-level Full TimeSan Francisco, CA; New York, NY3d ago
-
Manager, Data Platform - AI Engineering USD 160K-192KAI Agents | AWS | Azure | CI/CD | Compliance401k match | Employer provided vehicle | Medical dental vision income protection | Mobility stipend | Paid leave for bereavement/jury duty/voting/militarySenior-level Full TimeCharlotte, North Carolina, United States3d ago
-
AI-assisted workflows | Annotation Schema | Automated QA | Data Operations | Data QualityEquity compensation | Health benefits | Remote workSenior-level Full TimeSan Mateo, CA, United States R3d ago
-
Head of Applied Machine Learning USD 292K-343KData Science | Embeddings | Evaluation metrics | Experimentation | Feature EngineeringInclusive work environment | Professional growth and mentorshipExecutive-level Full TimeUnited States - Remote R3d ago
-
Senior Machine Learning Engineering Manager USD 120K-190KAWS | Algorithms | Azure | Data Exploration | Design PatternsSenior-level Full TimeCharlotte, North Carolina, United States; Denver, … R3d ago
-
Senior-level Full TimePhoenix, AZ, United States3d ago
-
Embedded Software V&V Manager USD 176K-316KAUTOSAR | Agile | Automated testing | Azure DevOps | C#Employee resource groups | Flexible family care days | Option to purchase additional vacation time | Paid Holidays | Paid parental leaveSenior-level Full TimePalo Alto, CA, United States R3d ago
-
Observability Product Manager with AI | Dynatrace SaaS | Burlington, MA | Hybrid | Independent Visa Required USD 150K-180KAIOps | Anomaly Detection | Artificial Intelligence | Automation | CI/CDConfidentiality | Hybrid work schedule | Long-term projectMid-level Contract Full TimeBurlington, MA, United States3d ago
-
API Integration | Agile | Artificial Intelligence | Automated testing | CI/CDMid-level Full TimeCupertino3d ago