Senior Machine Learning Engineer, Model Serving Infrastructure (Multiple Positions)
San Jose, California, United States
USD 264K-387K Senior-level Full Time
Tasks
- Analyze bottlenecks and instability sources
- Build monitoring and management tools
- Collaborate with stakeholders on ML engineering initiatives
- Design distributed inference infrastructure
- Design machine learning models for optimization
- Mentor junior machine learning engineers and interns
- Triage system inefficiency and bottlenecks
Perks/Benefits
- N/A
Skills/Tech-stack
Distributed Systems | Inference | Machine Learning | Model Serving | Monitoring | Online Inference | Python | Reliability Engineering | Scalability | System Performance
Education
N/A
Regions
Countries
States
Cities
Related jobs
-
Featured Feat. Principal Knowledge & Data Architect USD 174K-284KAWS Neptune | Canonicalization | Chunking | Cypher | DBTBenefits including health and wellness programs | Health, wellness, and retirement plansSenior-level Full TimeHeadquarters - Chevy Chase, MD R19d ago
-
Model Operations Engineer USD 107K-179KALiBi | AWS SageMaker | Amazon Lambda | Apache Airflow | AzureHealth insurance | Holiday pay | Learning and development | Life insurance | Long-term disabilitySenior-level Full TimeUSA-VA-Ashburn2h ago
-
AWS DMS | AWS Database | AWS Database Migration Service | AWS VPC | AWS database migrationSenior-level ContractAustin, United States3h ago
-
AI Search | API Design | API Integration | Azure AI | Azure AI LanguageSenior-level ContractColumbus, United States3h ago
-
AI/LLM Network Software Development Engineer Graduate (High Speed Network) - 2026 Start (PhD) USD 148K-300KAI | Data center | Data center networking | High Performance | High-performance networkingEntry-level Full TimeSeattle, Washington, United States3h ago
-
Benchmarking | Computer Vision | Data parallelism | Deep learning | Distributed TrainingMid-level Full TimeSeattle, Washington, United States3h ago
-
Computer Vision | Data parallelism | Deep learning | Distributed Training | Model AccelerationSenior-level Full TimeSeattle, Washington, United States3h ago
-
Software Development Engineer - AI/LLM Network - Global Frontier Tech Research Program - 2027 Start (PhD) USD 202K-368KAI infrastructure | C++ | Cause analysis | Elastic scaling | Fault LocalizationEntry-level Full TimeSeattle, Washington, United States3h ago
-
Machine Learning Engineer (Multiple Positions) USD 148K-300KAnalytics | Data Mining | Machine Learning | Model Optimization | PersonalizationEntry-level Full TimeSeattle, Washington, United States3h ago
-
Lead Machine Learning Engineer (Multiple Positions) USD 275K-450KAlgorithm Optimization | Code review | Data Pipelines | Deep learning | Infrastructure OptimizationSenior-level Full TimeSan Jose, California, United States3h ago
-
Senior Machine Learning Engineer - E-Commerce Supply Chain & Logistics (Multiple Positions) USD 224K-387KA/B | A/B Testing | B testing | Big Data | Big-data frameworksSenior-level Full TimeSan Jose, California, United States3h ago
-
Machine Learning Engineer (Multiple Positions) USD 174K-316KData Pipelines | Deep learning | Linux | Machine Learning | Model ServingMid-level Full TimeSan Jose, California, United States3h ago
-
Cross-layer Optimization | Diffusion Models | Distributed Training | Distributed task scheduling | Heterogeneous computingSenior-level Full TimeSan Jose, California, United States3h ago
-
Cloud Native | Containerization | Distributed Systems | GPU Acceleration | KubernetesCareer growth | Collaborative engineering environment | Global opportunities | Open Source contributionEntry-level Full TimeSan Jose, California, United States3h ago
-
Deep learning | GPU resource management | Language Models | Large Language Models | Machine LearningEntry-level InternshipSan Jose, California, United States3h ago
-
LLM AIOps Development Engineer Graduate (Data Center Networking) - 2026 Start (BS/ MS) USD 122K-256KAPI Integration | Anomaly Detection | Cause analysis | Continuous Monitoring | Data StreamingEntry-level Full TimeSan Jose, California, United States3h ago
-
Cloud Native | Cloud-native computing | Containerization | Distributed Systems | GPU AccelerationCareer growth | Collaborative team environment | Open source contributionsEntry-level Full TimeSeattle, Washington, United States3h ago
-
Production Engineer - Applied Machine Learning USD 156K-387KAlerting | Auto Scaling | Auto rollback | Auto-healing | CI/CDEntry-level Full TimeSan Jose, California, United States3h ago
-
CUDA | Distributed Systems | GPU | Language Models | Large Language ModelsCareer growth | Global team collaborationEntry-level Full TimeSan Jose, California, United States3h ago
-
Backup and Restore | Blob Storage | Cause analysis | Debugging | Distributed SystemsAgile environment | Collaborative team | On-call rotationSenior-level Full TimeSan Jose, California, United States3h ago
-
AI and DB | Automation | Backup and Restore | CPU Optimization | CXLMid-level Full TimeSeattle, Washington, United States3h ago
-
Software Development Engineer - Cloud Native Databases USD 156K-316KBackup and Restore | Blob Storage | Crash diagnostics | Database Schema | Database schema managementCollaborative work environment | Intellectual curiosity | On-call rotationMid-level Full TimeSan Jose, California, United States3h ago
-
Containerd | Docker | Go | Kubernetes | LinuxSenior-level Full TimeSeattle, Washington, United States3h ago
-
Machine Learning Engineer, AI Coding Tools USD 156K-387KDeep learning | Fine Tuning | GPU Computing | Inference acceleration | Language ModelsMid-level Full TimeSan Jose, California, United States3h ago
-
Site Reliability Engineer - Data (Seattle) USD 177K-341KApache Flink | Blameless postmortems | Capacity Planning | Incident Response | KubernetesMid-level Full TimeSeattle, Washington, United States3h ago