Inference Intern - Spring 2027
Tasks
- Add robust error handling
- Build programming abstractions for model porting
- Co design hardware instructions with model operations
- Debug correctness issues
- Develop runtime for multi node inference
- Implement high performance components for model toolkit
- Implement intra node execution
- Manage runtime state
- Optimize routing and communication layers
- Port machine learning models to custom architecture
- Profile performance
Perks/Benefits
Skills/Tech-stack
C++ | Compilers | Consensus Protocols | Consistency models | Distributed Systems | GPU | High speed | High-Speed Interconnects | Infiniband | JAX | Kernel Networking | Linux | Mixture of Experts | NVLink | Networking | Performance Profiling | PyTorch | Python | Rust | SGLang | SIMD | TPU | Transformer | User Space Networking | User space | VLLM
Education
Related jobs
-
Supercomputing Intern - Summer 2027 USD 40K-140KAlgorithms | C# | C++ | CI/CD | Data StructuresDaily meals | Direct mentorship | Housing supportEntry-level InternshipSan Jose10h ago
-
Supercomputing Intern - Spring 2027 USD 40K-140KAlgorithms | C# | C++ | CI_CD | Co-designDaily lunch and dinner | Housing support | MentorshipEntry-level InternshipSan Jose10h ago
-
Supercomputing Intern - Fall 2026 USD 40K-140KC# | C++ | CI/CD | Co-design | Data StructuresDaily Dinner | Daily lunch | Direct mentorship | Housing support | Relocation supportEntry-level InternshipSan Jose10h ago
-
Inference Intern - Summer 2027 USD 64K-142KAccelerator architectures | C++ | Compilers | Debugging | Distributed SystemsDaily Dinner | Daily lunch | Direct mentorship | Housing support | Paid internshipEntry-level InternshipSan Jose10h ago
-
Senior-level Full TimeBoston, Massachusetts11h ago
-
C++ | Distributed Systems | Fault Tolerance | Golang | InferenceBonus program | Company benefits program | Equity incentive plan | Hybrid workSenior-level Full TimeMountain View, CA, USA; San Francisco, …12h ago
-
Senior Software Engineer USD 140K-185KAWS | Automated testing | Azure | C++ | Git401K company matching | Dental insurance | Dependent care benefits | Flexible spending account | Health insuranceSenior-level Full TimeBoulder, CO R13h ago
-
AI Full Stack Developer & Architect USD 130K-180KCloud Run | Containerization | JavaScript | Kubernetes | MLOpsSenior-level Contract Full TimeSan Jose, CA, United States13h ago
-
Staff Software Engineer - Computer Vision USD 160K-210K3D Gaussian Splatting | AWS | Azure | Bundle adjustment | C++401k match | Commuter benefits | Dental insurance | Flexible work | Health insuranceSenior-level Full TimeRedwood City, CA14h ago
-
Software Engineer II - Data Warehousing USD 116K-174KAWS | Backend Development | ClickHouse | Data Modeling | Database SchemaMid-level Full TimeBoston, MA15h ago
-
Software Engineer 1 - AI/ML/Terraform/C++/AWS/GPU USD 130K-270KAWS | Artificial Intelligence | C++ | GPU | Golang401k contribution | Accidental death and dismemberment insurance | Dental insurance | Health Savings Account contribution | Life insuranceSenior-level Full TimeAnnapolis Junction, MD15h ago
-
Data Engineer Intern (Summer 2026) USD 54K-58KCloud Computing | Data Preprocessing | Data Visualization | Machine Learning | Power BICommunity engagement events | Hybrid work schedule | Mentorship from senior leadership | Paid internship | Professional development eventsEntry-level InternshipChicago, Illinois, United States18h ago
-
Software Engineer II - Model Platform USD 149K-214KAWS | Azure | Cloud Computing | Data Pipelines | Distributed SystemsMid-level Full TimeRemote - USA R19h ago
-
Senior Software Engineer (Typescript / FrontEnd) - AI/ML USD 141K-232KAPI Design | AWS | Azure | Cloud platform | Google CloudFlexible time off | Flexible work environment | Global gatherings | Healthcare | Home office setupSenior-level Full TimeUnited States (remote) R20h ago
-
Computer Vision | Data Preparation | Data Processing | Debugging | Distributed SystemsSenior-level Full TimeSunnyvale, CA, USA; Kirkland, WA, USA21h ago
-
Senior Software Developer, Embedded Systems/Firmware, XR USD 174K-252KAbstraction layer | Android | Android Hardware Abstraction Layer | Android hardware | BootloaderSenior-level Full TimeSan Jose, CA, USA; Waterloo, ON, …21h ago
-
Staff Software Engineer, AI/ML, App Ads Quality USD 207K-300KCross-Functional Collaboration | Cross-functional | Data Processing | Data Storage | Data StructuresSenior-level Full TimeMountain View, CA, USA21h ago
-
Agentic AI | Computer Vision | Continuous integration | Data Processing | DebuggingSenior-level Full TimeMountain View, CA, USA21h ago
-
Staff Software Engineer, NotebookLM, Generative AI, Labs USD 207K-300KAlerting | Computer Vision | Data Processing | Data Structures | Data structures algorithmsSenior-level Full TimeMountain View, CA, USA21h ago
-
Software Engineer III, AI/ML, Display Ads USD 147K-211KAlgorithms | C++ | Data Analysis | Data Processing | Data StructuresSenior-level Full TimeMountain View, CA, USA21h ago
-
Senior-level Full TimePeoria, IL, US, 6163923h ago
-
Senior Software Engineer USD 160K-255KAWS SQS | Artificial Intelligence | Elasticsearch | Go | JavaScriptSenior-level Full TimeNew York, NY1d ago
-
Sr. Staff Software Engineer - Managed Tables USD 228K-314KAlgorithms | Automation | Capacity Planning | Data Structures | Database systemsSenior-level Full TimeMountain View, California1d ago
-
Senior Embedded Software Engineer USD 170K-210KC++ | Cause analysis | Configuration Management | Device identity | Diagnostics401k | FSA or HSA | Health, dental, vision insurance | Incentive stock options | Pre-tax commuter benefitsSenior-level Full TimeEmeryville, United States1d ago
-
Forward Deployed Engineer USD 150K-250KAPIs | End to End | End-to-End Development | Go | Machine LearningTravel to client sitesEntry-level Full TimeSF Bay Area, CA1d ago