Software Engineer - AI Compute Infrastructure
San Jose, California, United States
USD 156K-387K Senior-level Full Time
Tasks
- Build cloud-native GPU and AI accelerator infrastructure
- Deliver LLM inference solutions using vLLM
- Design container-based cluster management systems
- Integrate Kubernetes and open source best practices
- Write production ready maintainable scalable code
Perks/Benefits
- N/A
Skills/Tech-stack
Cloud Native | Cluster management | Distributed Systems | GPU Acceleration | Kubernetes | Language Models | Large Language Models | Machine Learning | Microservices | Orchestration | Ray | Resilience | SGLang | Scalability | Scheduling | TensorRT-LLM | Testing | VLLM
Education
N/A
Roles
Regions
Countries
States
Cities
Related jobs
-
Model Operations Engineer USD 107K-179KALiBi | AWS SageMaker | Amazon Lambda | Apache Airflow | AzureHealth insurance | Holiday pay | Learning and development | Life insurance | Long-term disabilitySenior-level Full TimeUSA-VA-Ashburn2h ago
-
AI Search | API Design | API Integration | Azure AI | Azure AI LanguageSenior-level ContractColumbus, United States3h ago
-
AI/LLM Network Software Development Engineer Graduate (High Speed Network) - 2026 Start (PhD) USD 148K-300KAI | Data center | Data center networking | High Performance | High-performance networkingEntry-level Full TimeSeattle, Washington, United States3h ago
-
Benchmarking | Computer Vision | Data parallelism | Deep learning | Distributed TrainingMid-level Full TimeSeattle, Washington, United States3h ago
-
Machine Learning Engineer (Multiple Positions) USD 148K-300KAnalytics | Data Mining | Machine Learning | Model Optimization | PersonalizationEntry-level Full TimeSeattle, Washington, United States3h ago
-
Distributed Systems | Inference | Machine Learning | Model Serving | MonitoringSenior-level Full TimeSan Jose, California, United States3h ago
-
Lead Machine Learning Engineer (Multiple Positions) USD 275K-450KAlgorithm Optimization | Code review | Data Pipelines | Deep learning | Infrastructure OptimizationSenior-level Full TimeSan Jose, California, United States3h ago
-
Senior Machine Learning Engineer - E-Commerce Supply Chain & Logistics (Multiple Positions) USD 224K-387KA/B | A/B Testing | B testing | Big Data | Big-data frameworksSenior-level Full TimeSan Jose, California, United States3h ago
-
Machine Learning Engineer (Multiple Positions) USD 174K-316KData Pipelines | Deep learning | Linux | Machine Learning | Model ServingMid-level Full TimeSan Jose, California, United States3h ago
-
Cross-layer Optimization | Diffusion Models | Distributed Training | Distributed task scheduling | Heterogeneous computingSenior-level Full TimeSan Jose, California, United States3h ago
-
Cloud Native | Containerization | Distributed Systems | GPU Acceleration | KubernetesCareer growth | Collaborative engineering environment | Global opportunities | Open Source contributionEntry-level Full TimeSan Jose, California, United States3h ago
-
Deep learning | GPU resource management | Language Models | Large Language Models | Machine LearningEntry-level InternshipSan Jose, California, United States3h ago
-
LLM AIOps Development Engineer Graduate (Data Center Networking) - 2026 Start (BS/ MS) USD 122K-256KAPI Integration | Anomaly Detection | Cause analysis | Continuous Monitoring | Data StreamingEntry-level Full TimeSan Jose, California, United States3h ago
-
AI | Big Data | CPU | Cloud Native | Container RuntimeSenior-level Full TimeSan Jose, California, United States3h ago
-
Cloud Native | Cloud-native computing | Containerization | Distributed Systems | GPU AccelerationCareer growth | Collaborative team environment | Open source contributionsEntry-level Full TimeSeattle, Washington, United States3h ago
-
Production Engineer - Applied Machine Learning USD 156K-387KAlerting | Auto Scaling | Auto rollback | Auto-healing | CI/CDEntry-level Full TimeSan Jose, California, United States3h ago
-
Research Intern (AI/LLM Network) - 2026 Start (PhD) USD 137K-256KAI communication | Data Analysis | High speed | High-Speed Networking | LLMEntry-level InternshipSeattle, Washington, United States3h ago
-
CUDA | Distributed Systems | GPU | Language Models | Large Language ModelsCareer growth | Global team collaborationEntry-level Full TimeSan Jose, California, United States3h ago
-
Backup and Restore | Blob Storage | Cause analysis | Debugging | Distributed SystemsAgile environment | Collaborative team | On-call rotationSenior-level Full TimeSan Jose, California, United States3h ago
-
Apache Flink | Automation | Blameless postmortems | Capacity Planning | DeploymentDevelopment workshops | Hands-on experience | Internship | Social eventsEntry-level InternshipSeattle, Washington, United States3h ago
-
Apache Flink | Automation | Capacity Planning | Cloud Computing | Distributed SystemsDevelopment workshops | Social eventsEntry-level InternshipSan Jose, California, United States4h ago
-
AI and DB | Automation | Backup and Restore | CPU Optimization | CXLMid-level Full TimeSeattle, Washington, United States4h ago
-
Software Development Engineer - Cloud Native Databases USD 156K-316KBackup and Restore | Blob Storage | Crash diagnostics | Database Schema | Database schema managementCollaborative work environment | Intellectual curiosity | On-call rotationMid-level Full TimeSan Jose, California, United States4h ago
-
Containerd | Docker | Go | Kubernetes | LinuxSenior-level Full TimeSeattle, Washington, United States4h ago
-
Machine Learning Engineer, AI Coding Tools USD 156K-387KDeep learning | Fine Tuning | GPU Computing | Inference acceleration | Language ModelsMid-level Full TimeSan Jose, California, United States4h ago