Technical Lead Manager, Machine Learning Runtime & Serving
Tasks
- Architect ML runtime systems for edge and cloud
- Build distributed low latency fault tolerant backend systems
- Design profiling and benchmarking infrastructure
- Develop hardware aware performance optimizations
- Extend ML compilers and runtimes
- Guide technical vision for ML infrastructure
- Identify triage and eliminate ML stack bottlenecks
- Manage and grow engineering team
- Optimize real time latency and memory usage
- Partner with ML researchers on system workloads
- Transition ML workloads to JAX native runtime
Perks/Benefits
Skills/Tech-stack
Distributed Systems | Fault Tolerance | GPU Computing | JAX | Low Latency | Low-Latency Systems | Machine Learning | ONNX Runtime | OpenXLA | PJRT | Python | TPU | TVM | TensorRT
Education
Regions
Countries
States
Related jobs
-
Featured Feat. Principal Knowledge & Data Architect USD 174K-284KAWS Neptune | Canonicalization | Chunking | Cypher | DBTBenefits including health and wellness programs | Health, wellness, and retirement plansSenior-level Full TimeHeadquarters - Chevy Chase, MD R26d ago
-
AWS | CentOS | Enterprise Linux | Jupyter Notebooks | LinuxActive TS SCI clearance with polygraphSenior-level Full TimeColumbia, MD1h ago
-
Mid-level Full TimeChicago, IL; Chicago, IL; Chicago, IL R2h ago
-
Principal AI Software Engineering Lead / IT Architect 3 USD 140K-213KAPI | AWS | Agentic development | Agile | Artificial IntelligenceHybrid onsite 3 days per weekSenior-level ContractIrving, United States3h ago
-
Mid-level Full TimeUS-Kansas-Wichita5h ago
-
Cloud Native | Column-stores | Database Design | Distributed Systems | Document DatabasesSenior-level Full TimeSeattle, Washington, United States5h ago
-
Gen AI Developer Specialist USD 118K-204KAI Evaluation | AWS | AWS Bedrock | Access Management | Cause analysisSenior-level Full TimeUnited States5h ago
-
Mid-level Full TimeUS-Kansas-Wichita5h ago
-
AI infrastructure | Academic research | Cloud infrastructure | Distributed Systems | Machine LearningEntry-level Full TimeSeattle, Washington, United States5h ago
-
Academic research | Artificial Intelligence | Cloud infrastructure | Machine Learning | Open SourceEntry-level Full TimeSan Jose, California, United States5h ago
-
Cloud Computing | Column-stores | Database Design | Distributed Systems | Document DatabasesEntry-level Full TimeSan Jose, California, United States5h ago
-
Data cleaning | Data collection | Deep learning | Machine Learning | Model EvaluationSenior-level Full TimeSan Jose, California, United States5h ago
-
3D Generation | AIGC | Agentic Models | Computer Vision | Fine TuningEntry-level Full TimeSan Jose, California, United States5h ago
-
AI | CPU | GPU | Kubernetes | Machine LearningSenior-level Full TimeSan Jose, California, United States5h ago
-
Agentic Systems | Artificial Intelligence | Cross-functional | Cross-functional leadership | Design Systems401k match | Dental insurance | Life insurance | Medical insurance | Paid HolidaysMid-level Full TimeNew York5h ago
-
Software Engineer- Metadata Storage USD 156K-387KAutomation | Disaster Recovery | Distributed Systems | Distributed locking | Key-Value StorageMid-level Full TimeSan Jose, California, United States5h ago
-
API Integration | Agentic Systems | Artificial Intelligence | Cross-functional | Cross-functional leadership401k match | Dental insurance | Disability insurance | Life insurance | Long-term disabilityMid-level Full TimeNew York5h ago
-
Containerd | Docker | Go | Java | KubernetesSenior-level Full TimeSeattle, Washington, United States5h ago
-
AI | AI workloads | C++ | CPU | Distributed SystemsSenior-level Full TimeSeattle, Washington, United States5h ago
-
Research Scientist - LLM Training System as a Service - Global Frontier Tech Recruitment Program - 2027 Start (PhD) USD 212K-450KCUDA | Deep learning | Distributed Training | GPU Performance | Language ModelsEntry-level Full TimeSan Jose, California, United States5h ago
-
Backup and Recovery | Disaster Recovery | Fault Tolerance | High Availability | Monitoring and AlertingSenior-level Full TimeSan Jose, California, United States5h ago
-
Software Development Engineer - Cloud Native Databases USD 148K-300KBlob Storage | Database Schema | Database schema management | Distributed Systems | Distributed TransactionsAgile collaborative environment | On-call rotationMid-level Full TimeSeattle, Washington, United States5h ago
-
Alerting | Backup and Restore | Cloud infrastructure | Disaster Recovery | Distributed SystemsEntry-level Full TimeSeattle, Washington, United States5h ago
-
AI Engineer Graduate (Client Arch) - 2027 Start USD 100K-118KArtificial Intelligence | Automation | CI/CD | Code Refactoring | Continuous DeliveryEntry-level Full TimeSan Jose, California, United States6h ago
-
Machine Learning Engineer Intern (TikTok-Data-Search-Recommendation-Global E-Commerce) - 2027 Summer USD 112K-177KAlgorithms | Backend Engineering | C++ | Data Mining | Data PipelinesDevelopment workshops | Learning programs | Mentorship | Social eventsEntry-level InternshipSeattle, Washington, United States6h ago