Inference Runtime, Engineering Manager
San Francisco
USD 455K-555K Mid-level Full Time Found 10d ago
Tasks
- Collaborate with research and product teams
- Configure and optimize GPU hardware
- Develop instrumentation for system bottlenecks
- Implement new architecture techniques
- Improve throughput latency and efficiency
- Lead distributed AI systems
- Optimize model inference performance
- Refactor and scale production systems
Perks/Benefits
- N/A
Skills/Tech-stack
CUDA | Code Refactoring | Critical Systems | Distributed Systems | GPU | HPC Technologies | Hardware optimization | MPI | Model Architecture | NCCL | NVLink | Performance Tuning | Performance-critical systems | PyTorch
Education
Bachelor's | Master's | PhD
Regions
Countries
States
Language: en |
Views: 1 |
Clicks: 0
Related jobs
-
Production Engineering Manager USD 274K-290KAutomation | Autoscaling | Capacity Planning | Capacity modeling | Continuous load testingMid-level Full TimeNew York, NY2d ago
-
Engineering Manager, Borglet Machine Learning USD 197K-291KC++ Programming | C/C++ | C/C++ Programming | Containers | Data AnalysisBenefits | Bonus | EquitySenior-level Full TimeSunnyvale, CA, USA2d ago
-
AI/ML | AI/ML engineering | Ad-Tech | Cross-Functional Collaboration | Cross-functionalBenefits | Bonus | EquitySenior-level Full TimeMountain View, CA, USA2d ago
-
Flink Manager USD 176K-213KApache Flink | Cloud deployment | Data Lakes | Data Warehouses | Distributed SystemsSenior-level Full TimeUnited States - Remote R2d ago
-
Software Engineering Manager, Agentic AI USD 197K-291KAI Deployment | Artificial Intelligence | Automation | Data Compression | Distributed SystemsBenefits | Bonus | EquitySenior-level Full TimeSunnyvale, CA, USA3d ago
-
Distributed Systems | Hardware Architecture | Leadership | Networking | System OptimizationBenefits | Bonus | EquitySenior-level Full TimeKirkland, WA, USA; Sunnyvale, CA, USA4d ago
-
Manager AI Strategic Delivery USD 100K-148KAWS | Azure | Communication | Copilot | Data ProtectionBenefits | Family-like culture | Flexible work | Organizational growth opportunities | Work-life balanceMid-level Full TimeOmaha, NE, 68102, USA4d ago
-
Manager, Data Engineer USD 154K-216KAzure | Azure Data | Azure Data Lake | Data Factory | Data Lake401k match | Disability insurance | Flexible spending accounts | Holidays | Life insuranceMid-level Full TimeBeaverton, OR, United States4d ago
-
AI/ML | AWS | Automation frameworks | Azure | Cloud PlatformsMid-level Full TimeRemote - US R5d ago
-
Software Development Snr Manager USD 118K-251KA2A protocols | AI Agent | AI Agent Frameworks | AI tools | Agent FrameworksAdoption Assistance | Dental insurance | Disability insurance | Employee stock purchase | Flexible spendingSenior-level Full TimeUnited States5d ago
-
AI ecosystem | Cloud Computing | Distributed Systems | Large-Scale System Design | Large-scale systemBenefits | Bonus | EquitySenior-level Full TimeSeattle, WA, USA5d ago
-
AI integration | AI platforms | Agent systems | C# | C++Benefits | Bonus | EquitySenior-level Full TimeSunnyvale, CA, USA5d ago
-
Senior Data Manager USD 137K-160K.NET | APIs | Accumulo | Big Data | Big data processing401k | Dental | Disability plans | Health insurance | HolidaysSenior-level Full TimeReston, VA, United States5d ago
-
Senior Product Manager USD 156K-234KAI/ML | Cloud Native | Cloud-native technologies | Communication skills | Data WorkloadsSenior-level Full TimeSan Francisco - Remote, CA, United … R5d ago
-
Software Engineering Program Manager USD 188K-265KAI frameworks | Agile methodologies | Cross-Functional Communication | Cross-functional | DL model optimizationHealth benefits | Retirement plans | Stock & bonuses | Vacation | Work flexibilityMid-level Full TimeUSA - OR - Hillsboro, United …5d ago
-
AI | Agentic Architectures | Cloud Computing | Customer Engagement | DebuggingCareer growth | Flexible organization | Inclusive culture | Innovation environment | MentorshipSenior-level Full TimeNew York, New York, USA5d ago
-
Software Development Manager, Items and Offers Platform, Relationship Inference and Correction USD 203K-275KAWS | Distributed Systems | Machine Learning | Project Management | Service architectureMid-level Full TimeNew York, New York, USA6d ago
-
Technical Program Manager - Enterprise Software USD 136K-212KAI | Communication | Configuration Management | Deep learning | Generative AIBenefits | EquityMid-level Full TimeUS, CA, Santa Clara, United States6d ago
-
AI research | Code review | Communication | Data Filtering | Data InfrastructureMid-level Full TimeMenlo Park, CA9d ago
-
Technical Program Manager, RL Developer Infrastructure USD 167K-230KAI Technology | Architectural Design | CI/CD | CI/CD processes | CommunicationSenior-level Full TimeBellevue, WA | Burlingame, CA10d ago
-
AI | Artificial Intelligence | Cloud infrastructure | Compute Infrastructure | Data CompressionBenefits | Bonus | EquitySenior-level Full TimeSeattle, WA, USA10d ago
-
Software Engineering Manager - FDB USD 236K-339KCloud Database | Cloud Database Systems | Concurrency | Database Internals | Database systemsSenior-level Full TimeUS-CA-Menlo Park11d ago
-
Build processes | Co-design | Code Reviews | Communication libraries | Distributed SystemsMid-level Full TimeCupertino, California, USA11d ago
-
Senior Manager AI Engineer (GenAI Platform Services) USD 229K-286KAI Optimization | AI infrastructure | AWS | Experimentation | GovernanceFinancial benefits | Health benefits | Inclusive cultureSenior-level Full TimeSan Jose, CA, United States11d ago
-
BN31T1- Data Scientist Technical Manager USD 145K-193KAWS | Agent systems | Azure | Cloud deployment | Data ScienceDental | Medical | Retirement | Vacation | VisionSenior-level Full TimeColumbus, Ohio, United States12d ago