Software Engineer Graduate (Inference Infrastructure) - 2026 Start (PhD)
San Jose, California, United States
USD 156K-316K Entry-level Full Time
Tasks
- Architect cloud native GPU infrastructure
- Build container orchestration systems
- Collaborate on LLM inference solutions
- Deliver cost efficient secure ML platforms
- Design cluster management systems
- Integrate best practices into production systems
- Stay current with Kubernetes and AI infrastructure
- Write production ready maintainable testable scalable code
Perks/Benefits
Skills/Tech-stack
Cloud Native | Containerization | Distributed Systems | GPU Acceleration | Kubernetes | LLM Inference | Machine Learning | Performance Engineering | Programming | Ray | SGLang | Scheduling | Secure Systems | TensorRT-LLM | VLLM
Education
Roles
Regions
Countries
States
Cities
Related jobs
-
Model Operations Engineer USD 107K-179KALiBi | AWS SageMaker | Amazon Lambda | Apache Airflow | AzureHealth insurance | Holiday pay | Learning and development | Life insurance | Long-term disabilitySenior-level Full TimeUSA-VA-Ashburn2h ago
-
AI Search | API Design | API Integration | Azure AI | Azure AI LanguageSenior-level ContractColumbus, United States3h ago
-
AI/LLM Network Software Development Engineer Graduate (High Speed Network) - 2026 Start (PhD) USD 148K-300KAI | Data center | Data center networking | High Performance | High-performance networkingEntry-level Full TimeSeattle, Washington, United States3h ago
-
Benchmarking | Computer Vision | Data parallelism | Deep learning | Distributed TrainingMid-level Full TimeSeattle, Washington, United States3h ago
-
Machine Learning Engineer (Multiple Positions) USD 148K-300KAnalytics | Data Mining | Machine Learning | Model Optimization | PersonalizationEntry-level Full TimeSeattle, Washington, United States3h ago
-
Distributed Systems | Inference | Machine Learning | Model Serving | MonitoringSenior-level Full TimeSan Jose, California, United States3h ago
-
Lead Machine Learning Engineer (Multiple Positions) USD 275K-450KAlgorithm Optimization | Code review | Data Pipelines | Deep learning | Infrastructure OptimizationSenior-level Full TimeSan Jose, California, United States3h ago
-
Senior Machine Learning Engineer - E-Commerce Supply Chain & Logistics (Multiple Positions) USD 224K-387KA/B | A/B Testing | B testing | Big Data | Big-data frameworksSenior-level Full TimeSan Jose, California, United States3h ago
-
Machine Learning Engineer (Multiple Positions) USD 174K-316KData Pipelines | Deep learning | Linux | Machine Learning | Model ServingMid-level Full TimeSan Jose, California, United States3h ago
-
Cross-layer Optimization | Diffusion Models | Distributed Training | Distributed task scheduling | Heterogeneous computingSenior-level Full TimeSan Jose, California, United States3h ago
-
Deep learning | GPU resource management | Language Models | Large Language Models | Machine LearningEntry-level InternshipSan Jose, California, United States3h ago
-
LLM AIOps Development Engineer Graduate (Data Center Networking) - 2026 Start (BS/ MS) USD 122K-256KAPI Integration | Anomaly Detection | Cause analysis | Continuous Monitoring | Data StreamingEntry-level Full TimeSan Jose, California, United States3h ago
-
AI | Big Data | CPU | Cloud Native | Container RuntimeSenior-level Full TimeSan Jose, California, United States3h ago
-
Cloud Native | Cloud-native computing | Containerization | Distributed Systems | GPU AccelerationCareer growth | Collaborative team environment | Open source contributionsEntry-level Full TimeSeattle, Washington, United States3h ago
-
Production Engineer - Applied Machine Learning USD 156K-387KAlerting | Auto Scaling | Auto rollback | Auto-healing | CI/CDEntry-level Full TimeSan Jose, California, United States3h ago
-
Research Intern (AI/LLM Network) - 2026 Start (PhD) USD 137K-256KAI communication | Data Analysis | High speed | High-Speed Networking | LLMEntry-level InternshipSeattle, Washington, United States3h ago
-
CUDA | Distributed Systems | GPU | Language Models | Large Language ModelsCareer growth | Global team collaborationEntry-level Full TimeSan Jose, California, United States3h ago
-
Backup and Restore | Blob Storage | Cause analysis | Debugging | Distributed SystemsAgile environment | Collaborative team | On-call rotationSenior-level Full TimeSan Jose, California, United States3h ago
-
AI and DB | Automation | Backup and Restore | CPU Optimization | CXLMid-level Full TimeSeattle, Washington, United States3h ago
-
Software Development Engineer - Cloud Native Databases USD 156K-316KBackup and Restore | Blob Storage | Crash diagnostics | Database Schema | Database schema managementCollaborative work environment | Intellectual curiosity | On-call rotationMid-level Full TimeSan Jose, California, United States3h ago
-
Containerd | Docker | Go | Kubernetes | LinuxSenior-level Full TimeSeattle, Washington, United States3h ago
-
Machine Learning Engineer, AI Coding Tools USD 156K-387KDeep learning | Fine Tuning | GPU Computing | Inference acceleration | Language ModelsMid-level Full TimeSan Jose, California, United States3h ago
-
Site Reliability Engineer - Data (Seattle) USD 177K-341KApache Flink | Blameless postmortems | Capacity Planning | Incident Response | KubernetesMid-level Full TimeSeattle, Washington, United States3h ago
-
Software Engineer - AI Compute Infrastructure USD 156K-387KCloud Native | Cluster management | Distributed Systems | GPU Acceleration | KubernetesSenior-level Full TimeSan Jose, California, United States3h ago
-
Site Reliability Engineer - Data USD 136K-359KApache Flink | Automation | Capacity Planning | Cloud infrastructure | Incident ManagementMid-level Full TimeSan Jose, California, United States3h ago