Software Engineer Intern (Inference Infrastructure) - 2026 Summer (MS/BS)
San Jose, California, United States
USD 118K-219K (estimate) Entry-level Internship
Tasks
- Architect cloud-native GPU and AI infrastructure
- Build container-based orchestration systems
- Collaborate on inference solutions using vLLM, SGLang, TensorRT-LLM
- Design large-scale cluster management systems
- Research and integrate open-source AI/ML advancements
- Write maintainable production code
Perks/Benefits
- Development workshops
- Hands-on experience
- Industry exposure
- Personal and professional growth
- Social events
Skills/Tech-stack
AI | Cloud Native | Distributed Systems | GPU Acceleration | Inference infrastructure | Kubernetes | ML | Open Source | Ray | Systems research | TensorRT
Related jobs
-
Automation Testing | CI/CD | CSS | Cypress | Feature DevelopmentMedical, dental & vision coverage | Paid time off | Parental leave | Reimbursement programs | Retirement planMid-levelRaleigh, United States R11d ago
-
Senior-level Full TimeUSA - Atlanta, GA; USA - …9h ago
-
Staff Software Engineer - Distributed Data Systems USD 182K-247KACID transactions | Algorithms | Apache Spark | C++ | Data StructuresSenior-level Full TimeBellevue, Washington11h ago
-
Senior Software Engineer - Distributed Data Systems USD 157K-213KACID transactions | Algorithms | Apache Spark | C++ | Data StructuresSenior-level Full TimeBellevue, Washington11h ago
-
Senior AI Software Engineer USD 160K-198KA2A | ADK | API | Containers | EnvoyNo visa sponsorship | Remote workSenior-level Full TimeRemote US R13h ago
-
Member of Technical Staff - Infrastructure Supercompute USD 180K-370KAnsible | ArgoCD | Docker | Flux | Go401k retirement plan | Dental insurance | Discounts and perks | Life insurance | Long-term disability insuranceSenior-level Full TimePalo Alto, CA; Seattle, WA14h ago
-
Distinguished Software Engineer, Data Infrastructure USD 248K-406KAI Inference | AI Training | Batch Processing | Compliance | Data InfrastructureExecutive-level Full TimeMountain View, CA, United States17h ago
-
Senior Software Engineer - AI Coding Agents USD 160K-235KAI SDK | API Routes | Auth | CI/CD | DockerSenior-level Full TimeUSA - Atlanta, GA; USA - …18h ago
-
Senior Software Engineer - Data Platform USD 150K-195KAPIs | BigQuery | C++ | CI/CD | Cloud Storage401k company contribution | Disability insurance | Fertility and infertility benefits | Industry competitive PTO | Learning and development opportunitiesSenior-level Full TimeUnited States R19h ago
-
Staff Software Engineer, Data USD 270KApache Flink | Apache Kafka | Apache Spark | Cloud Data | Cloud data warehousing401k matching | ADND Insurance | Company holidays | Extended parental leave | Flexible spending accountSenior-level Full TimeUSA, Palo Alto21h ago
-
Software Engineer, Data Security - USDS USD 118K-237KData Security | Distributed Systems | Language Models | Large Language Models | Performance optimizationEntry-level Full TimeSan Jose, California, United States23h ago
-
Software Engineer - Language (Technical Leadership) USD 213K-293KASR | Benchmarking | C# | C++ | Conversational AISenior-level Full TimeMenlo Park, CA | Seattle, WA …23h ago
-
Business Support Engineer USD 159K-223KCloud Computing | Data Analysis | Data Mining | Distributed Systems | Docker24x7 on-call rotation | Cross-functional team collaboration | Global partner supportSenior-level Full TimeMenlo Park, CA23h ago
-
Staff Software Engineer, Torch TPU USD 207K-300KCUDA | Computer Vision | Data Processing | Debugging | Distributed SystemsSenior-level Full TimeSunnyvale, CA, USA1d ago
-
Sr. Back-End Software Engineer - Machine Learning USD 170K-250KC++ | Computer Vision | Distributed Systems | Language Processing | Linux401k matching | Commuter benefits | Dependent Family Medical Premium Coverage | Employee Medical Premium Coverage | Employee referral programSenior-level Full TimeSanta Clara, CA1d ago
-
Software Engineer, Platform - Kansas City, USA USD 140K-200KCloud platform | Docker | Google Cloud | Google Cloud Platform | KubernetesAsynchronous work culture | Autonomy | Distributed work | Portfolio and LinkedIn submissionSenior-level Full TimeKansas City, USA1d ago
-
API Integration | Apache Airflow | Apache Beam | Bash | BigQuerySenior-level Full TimeHome, United States R1d ago
-
AI | AI Platform | Cloud Computing | Data Engineering | Data GovernanceCompany holidays | Dental insurance | Disability insurance | Employee assistance program | Life insuranceMid-level Full TimeAtlanta, GA, US1d ago
-
AI Engineer Senior USD 159K-188KAWS | Agentic AI | Asynchronous programming | Azure | Batching401k match | Fertility and family building aids | Health insurance | Life and disability insurance | Paid HolidaysSenior-level Full TimeNorth Dallas Campus, United States1d ago
-
GenAI Principal Engineer - Remote USD 145K-215KAI orchestration | API first | API-first design | AWS | Android401k matching | DEI focus | Development opportunities | Flexible schedule | Flexible time offSenior-level Full TimeUnited States, UNITED STATES, United States R1d ago
-
Senior Robotics Engineer USD 70K-200KAgent autonomy | Agent systems | Control Theory | DevOps | DockerSenior-level Full TimeIrvine, CA1d ago
-
Software Engineer, Infrastructure Reliability USD 255K-405KAWS | Automation | Best practices | CI/CD | Cloud infrastructureSenior-level Full TimeSan Francisco1d ago
-
Deployed Engineer (Raleigh) USD 150K-250KAWS | Agent Orchestration | Azure | Cloud Computing | Docker401k plan | Flexible vacation | Life insurance | Life insurance coverage | Medical, dental & vision coverageMid-level Full TimeRaleigh, NC1d ago
-
Deployed Engineer (Charlotte) USD 150K-250KAWS | Agent Orchestration | Cloud platform | Containers | Failure handling401k plan | Dental insurance | Flexible vacation | Life insurance | Medical insuranceMid-level Full TimeCharlotte, NC1d ago
-
Staff Software Engineer, Model LifeCycle USD 208K-253KAPI Design | Checkpointing | Distributed Training | Failure recovery | Fine Tuning401k match | Cell phone stipend | Commuter benefits | Dental insurance | Employer HSA contributionsSenior-level Full TimeSan Francisco, CA - US1d ago