Inference Intern - Summer 2027
Tasks
- Add robust error handling
- Build programming abstractions for model porting
- Build runtime for multi node inference
- Co-design hardware instructions and model operations
- Debug correctness issues
- Develop high performance software components for model toolkit
- Develop testing capabilities for model porting
- Implement state management
- Improve intra node execution
- Optimize routing and communication layers
- Port transformer models to custom architecture
- Use performance profiling tools to find bottlenecks
Perks/Benefits
Skills/Tech-stack
Accelerator architectures | C++ | Compilers | Debugging | Distributed Systems | GPU | High speed | High-Speed Interconnects | Infiniband | JAX | Linux | MOE | Mixture of Experts | NVLink | Networking | Performance Profiling | PyTorch | Python | Rust | SIMD | TPU | Transformer Architectures | Transformer Inference
Education
Related jobs
-
Supercomputing Intern - Summer 2027 USD 40K-140KAlgorithms | C# | C++ | CI/CD | Data StructuresDaily meals | Direct mentorship | Housing supportEntry-level InternshipSan Jose10h ago
-
Supercomputing Intern - Spring 2027 USD 40K-140KAlgorithms | C# | C++ | CI_CD | Co-designDaily lunch and dinner | Housing support | MentorshipEntry-level InternshipSan Jose10h ago
-
Supercomputing Intern - Fall 2026 USD 40K-140KC# | C++ | CI/CD | Co-design | Data StructuresDaily Dinner | Daily lunch | Direct mentorship | Housing support | Relocation supportEntry-level InternshipSan Jose10h ago
-
Inference Intern - Spring 2027 USD 60K-142KC++ | Compilers | Consensus Protocols | Consistency models | Distributed SystemsDaily Dinner | Daily lunch | Direct mentorship | Housing support | Paid internshipEntry-level InternshipSan Jose10h ago
-
Senior-level Full TimeBoston, Massachusetts12h ago
-
C++ | Distributed Systems | Fault Tolerance | Golang | InferenceBonus program | Company benefits program | Equity incentive plan | Hybrid workSenior-level Full TimeMountain View, CA, USA; San Francisco, …13h ago
-
Senior Software Engineer USD 140K-185KAWS | Automated testing | Azure | C++ | Git401K company matching | Dental insurance | Dependent care benefits | Flexible spending account | Health insuranceSenior-level Full TimeBoulder, CO R14h ago
-
AI Full Stack Developer & Architect USD 130K-180KCloud Run | Containerization | JavaScript | Kubernetes | MLOpsSenior-level Contract Full TimeSan Jose, CA, United States14h ago
-
Staff Machine Learning Engineer, Voice AI USD 220K-280KAudio codecs | Audio signal processing | Batching | CUDA | Deep learningHealth insurance | Startup equitySenior-level Full TimeSan Francisco14h ago
-
Anomaly Detection | Causal Inference | Clean rooms | Conversion API | Data PipelinesSenior-level Full TimeSan Francisco, CA, US; Palo Alto, …14h ago
-
Staff Software Engineer - Computer Vision USD 160K-210K3D Gaussian Splatting | AWS | Azure | Bundle adjustment | C++401k match | Commuter benefits | Dental insurance | Flexible work | Health insuranceSenior-level Full TimeRedwood City, CA15h ago
-
Software Engineer II - Data Warehousing USD 116K-174KAWS | Backend Development | ClickHouse | Data Modeling | Database SchemaMid-level Full TimeBoston, MA16h ago
-
Software Engineer 1 - AI/ML/Terraform/C++/AWS/GPU USD 130K-270KAWS | Artificial Intelligence | C++ | GPU | Golang401k contribution | Accidental death and dismemberment insurance | Dental insurance | Health Savings Account contribution | Life insuranceSenior-level Full TimeAnnapolis Junction, MD16h ago
-
Entry-level Full TimeCary, NC, United States18h ago
-
Machine Learning Engineer USD 150K-215KData Augmentation | Deep learning | Isaac | Loss Functions | Medical ImagingMid-level Full TimeSan Francisco (hybrid) R18h ago
-
Data Engineer Intern (Summer 2026) USD 54K-58KCloud Computing | Data Preprocessing | Data Visualization | Machine Learning | Power BICommunity engagement events | Hybrid work schedule | Mentorship from senior leadership | Paid internship | Professional development eventsEntry-level InternshipChicago, Illinois, United States18h ago
-
Cloud Computing | Data Pipelines | Experimental Design | Java | Machine LearningCommunity volunteering | Internal mobility | Learning opportunities | Mentorship programs | Recognition programsMid-level Full TimeAustin, TX, United States19h ago
-
Software Engineer II - Model Platform USD 149K-214KAWS | Azure | Cloud Computing | Data Pipelines | Distributed SystemsMid-level Full TimeRemote - USA R20h ago
-
Data Analysis | Distributed Systems | Experimentation | Information Retrieval | Language ModelsSenior-level Full TimeSan Jose, California, United States20h ago
-
Senior Software Engineer (Typescript / FrontEnd) - AI/ML USD 141K-232KAPI Design | AWS | Azure | Cloud platform | Google CloudFlexible time off | Flexible work environment | Global gatherings | Healthcare | Home office setupSenior-level Full TimeUnited States (remote) R21h ago
-
Computer Vision | Data Preparation | Data Processing | Debugging | Distributed SystemsSenior-level Full TimeSunnyvale, CA, USA; Kirkland, WA, USA21h ago
-
Senior Software Developer, Embedded Systems/Firmware, XR USD 174K-252KAbstraction layer | Android | Android Hardware Abstraction Layer | Android hardware | BootloaderSenior-level Full TimeSan Jose, CA, USA; Waterloo, ON, …21h ago
-
Staff Software Engineer, AI/ML, App Ads Quality USD 207K-300KCross-Functional Collaboration | Cross-functional | Data Processing | Data Storage | Data StructuresSenior-level Full TimeMountain View, CA, USA21h ago
-
Agentic AI | Computer Vision | Continuous integration | Data Processing | DebuggingSenior-level Full TimeMountain View, CA, USA21h ago
-
Staff Software Engineer, NotebookLM, Generative AI, Labs USD 207K-300KAlerting | Computer Vision | Data Processing | Data Structures | Data structures algorithmsSenior-level Full TimeMountain View, CA, USA21h ago