Engineering Manager, LLM Performance
Tasks
- Accelerate LLM inference performance
- Design implement optimize inference features
- Develop production quality software libraries
- Improve inference performance on NVIDIA GPUs
- Integrate NVIDIA technologies for LLM deployment
- Lead and grow engineering team
- Plan projects deliver milestones coordinate cross functional teams
- Tune performance for key workloads using benchmarks
Perks/Benefits
Skills/Tech-stack
API Development | C++ | CUDA | Distributed Systems | GPU Architecture | Inference Optimization | Language Models | Large Language Models | Performance Tuning | Python | SGLang | Software Design | System Performance | System performance tuning | TensorRT | VLLM
Education
Regions
Countries
States
Cities
Related jobs
-
Featured Feat. Associate Director, Data Labs USD 167K-167KAWS | Cloud Computing | Compute Infrastructure | Data Analysis | LLM GovernanceConference speaking opportunities | Hybrid work schedule | Media appearancesSenior-level Full TimeWashington, District of Columbia, 20004, United … R3d ago
-
Director, AI Product Manager USD 170K-220KAI FinOps | AI Governance | AIOps | Amazon SageMaker | Apache SparkAdoption Assistance | Disability insurance | Educational assistance | Flexible spending account | Health benefits (medical, dental, vision)Executive-level Full TimeLisle, Illinois21h ago
-
Managers, Data Science USD 90K-165KDecision Trees | HiveQL | Linear Regression | Logistic Regression | Machine LearningAccess to wellness centers | Career development and training opportunities | Comprehensive medical, dental, vision and life insurance | Disability benefits | Free counseling supportMid-level Full TimeNew York, NY, United States1d ago
-
Data Scientist Manager USD 129K-167KAWS | Big Data | CPT | DRG | Data analytics401k match | Dental insurance | Flexible schedule | Health insurance | Long-term disabilitySenior-level Full TimeUSA VA Home Office (VAHOME), United …1d ago
-
AVP, Business Insights and Analytics USD 169K-175KAlteryx | Change Management | Data Dictionary | Data Governance | Data Lineage401k | Dental insurance | Incentive Award Eligible | Life insurance | Medical insuranceExecutive-level Full TimeBuilding 400-Whippany Campus, Jefferson Park, United …1d ago
-
Data Engineer III USD 74K-84KAzure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake Storage | Azure Data WarehouseAdoption Assistance | Behavioral health solutions | Employee resource groups | Mentorship programs | Paid caregiver leaveSenior-level Full TimeUSA - TX - Carrollton - …1d ago
-
Principal Analytics Engineer USD 155K-276KAutomation | CI/CD | DBT | Data Catalog | Data GovernanceFlexible work schedule | Health and wellness benefits | Professional development support | Remote and in-office flexibilitySenior-level Full TimeUSA, CA, Pleasanton, United States1d ago
-
Lead Data Analysis USD 130K-196KAPI Integration | Azure OpenAI | Copilot Studio | CrewAI | DBT401k plan | Adoption reimbursement | Disability benefits | Employee assistance program | Employee discountsSenior-level Full TimeDallas, Texas1d ago
-
Business Analytics Manager (Digital) USD 96K-181KBig Data | Business Intelligence | Data Mining | Data Modeling | Data VisualizationMid-level Full Time4910 Tiedeman Road, Brooklyn, OH, United …1d ago
-
Access Control | Azure Data | Azure Data Factory | Azure Data Lake | Azure Data Lake StorageSenior-level Full TimeUSA-MN-Minneapolis-801 Nicollet Mall, United States R1d ago
-
Senior Manager, Data Engineering USD 75K-208KAzure | Azure Synapse | Azure Synapse Analytics | C# | Complex SQLCalm app subscription | Days of disconnect | EAP | EAP support | Flexible work location within United StatesSenior-level Full TimeTX Frisco 2600 North Dallas Parkway, …1d ago
-
Data Warehouse Sr. Manager USD 70K-140KAWS | Agile | Business Intelligence | Data Governance | Data LakeFlexible work arrangementSenior-level Full TimeEaston Ops Cols C Oh, United …1d ago
-
Account Management | Agile | Atlassian Tool Suite | Bitbucket | Budget Management10 percent travel | 9/80 schedule | Onsite work | Relocation assistanceMid-level Full TimeMDLI02, United States1d ago
-
Director, Data & Analytics Engineering USD 125K-135KAPI Development | Calculus | Decision Tree | Deep learning | Distributed TrainingTelecommuting up to 2 days per weekExecutive-level Full TimeAlpharetta GA 6655, United States R1d ago
-
Principal Engineer - Data Ingestion & AI Pipeline USD 122K-173KAI Document Intelligence | Access Control | Apache Airflow | Apache Kafka | Apache SparkFlexible benefitsSenior-level Full TimeCharlotte, United States1d ago
-
Product Manager - Tech Delivery USD 102K-149KAgile | Apache Cassandra | Database Administration | Database Modeling | Database securityMid-level Full TimeChandler, United States1d ago
-
Manager, Data Science USD 170K-267KAmazon Web Services | Apache Spark | Conda | H2O | Machine LearningEmployee referral program | Telecommuting permittedSenior-level Full TimeMcLean, VA, United States R1d ago
-
Consumer Banking American Dream Analytics Director USD 180K-237KA/B | A/B Testing | Agentic AI | Artificial Intelligence | Attribution ModelingExecutive-level Full TimeColumbus, OH, United States1d ago
-
Supervisor of AI Software Engineering USD 185K-195KAPI Development | Agile | Azure DevOps | CI/CD | CORS401k plan | Disability insurance | Health insurance | Life insurance | PTO programMid-level Full TimeLos Angeles, CA, United States2d ago
-
Cash Flow | Cash flow modeling | Credit Risk | Dashboarding | Data AnalysisMid-level Full TimeHeadquarters 4, United States2d ago
-
VP Marketing Data Science USD 129K-194KA/B | A/B Testing | B testing | Data Visualization | Dataiku401k | Accident insurance | Disability insurance | Life insurance | Medical, dental, and vision coverageExecutive-level Full TimeLocation(s): New York, New York, United …2d ago
-
Senior Manager, Business Intelligence and Data Analytics USD 125K-140KA/B | A/B Testing | Anomaly Detection | Apache Spark | B testing401k match | Career development | Dental insurance | Medical insurance | Merchandise discountsSenior-level Full TimeNew York, NY, United States3d ago
-
Manager, Data Analytics USD 111K-145KAggregations | CTE | Dashboard Development | Data Analysis | Data Management401k plan participation | Annual performance bonuses | Disability insurance | Life insurance | Medical/Dental/Vision insuranceMid-level Full TimeAtlanta, Georgia, United States3d ago
-
Manager, Data Analytics USD 111K-145KAggregations | Business Reporting | CTE | Dashboards | Data Analysis401k plan participation | Annual performance bonuses | Hybrid work schedule | Life and disability insurance | Medical, dental, and vision benefitsMid-level Full TimeDallas, Texas, United States3d ago
-
Manager, Data Analytics USD 111K-145KAggregations | CTE | Dashboards | Data Management | Data Visualization11 paid holidays | 401k plan participation | Annual performance bonuses | Life and disability insurance | Medical, dental, vision benefitsMid-level Full TimeTempe, Arizona, United States3d ago