Inference Intern
Tasks
- Add robust error handling
- Build programming abstractions for model porting
- Build runtime for transformer inference
- Co-design hardware instructions and model operations
- Debug performance and correctness issues
- Develop testing capabilities for model porting
- Enhance intra node execution
- Enhance multi node inference
- Implement high performance software components for model toolkit
- Implement state management
- Optimize routing and communication layers
- Perform performance profiling
- Support model porting to accelerator architecture
- Use collective communication for inference performance
Perks/Benefits
Skills/Tech-stack
C++ | Collective communication | Compilers | Consensus Protocols | Consistency models | Debugging | Distributed Systems | Error Handling | High speed | High-speed interconnect | Infiniband | Intra Node Execution | JAX | Kernel Networking | Linux | MOE | Mixture of Experts | Multi node inference | Multi-node | NVLink | Performance Profiling | PyTorch | Python | Rust | SGLang | SIMD | State management | Transformer Architecture | User Space Networking | User space | VLLM
Education
Regions
Countries
States
Cities
Related jobs
-
AVFoundation | Android | Android GPU Inspector | C# | C++Senior-level Full TimeSan Jose, California, United States7h ago
-
A/B | A/B Testing | B testing | Causal Inference | Data MiningEntry-level InternshipSan Jose, California, United States7h ago
-
Software Engineer, C/C++ SDK Performance Optimization USD 194K-355KAVFoundation | Android | Android GPU Inspector | Battery optimization | C#Senior-level Full TimeSan Jose, California, United States7h ago
-
Research Engineer Robotics (Operations) USD 113K-190KBuild systems | C plus plus | CI/CD | Control Policies | Data PipelinesSenior-level Full TimeRedmond, WA8h ago
-
Software Engineer III, Generative AI, Workspace Drive USD 147K-211KAlgorithms | Computer Vision | Data Preparation | Data Structures | DebuggingSenior-level Full TimeBoulder, CO, USA8h ago
-
Tech Lead, Google Kubernetes Engine AI Platform USD 207K-301KArtificial Intelligence | Cloud Computing | Cloud platform | Data Storage | Data analyticsSenior-level Full TimeSeattle, WA, USA; Kirkland, WA, USA8h ago
-
Senior Software Engineer, Head Tracking, Beam, AI/ML USD 174K-253K3D Imaging | 3D Tracking | Augmented Reality | C++ | Computer VisionSenior-level Full TimeSeattle, WA, USA; Mountain View, CA, …8h ago
-
AI Solutions Deployment Manager, Cloud Applied AI USD 183K-266KAPI Development | Agentic AI | Cloud Architecture | Cloud platform | Conversational AISenior-level Full TimeWaterloo, ON, Canada; New York, NY, …8h ago
-
AI Solutions Deployment Manager, Cloud Applied AI, Telco USD 183K-266KAPI tools | Agentic AI | Architectural Guidance | Cloud Architecture | Cloud platformSenior-level Full TimeWaterloo, ON, Canada; New York, NY, …8h ago
-
Staff Software Engineer USD 114K-178KAI Safety | AWS | AWS Bedrock | Agentic Systems | AirflowHealth insurance | Paid time off | Retirement contributionsSenior-level Full TimeSt. Louis, Missouri, US, 63103-235513h ago
-
AI Research Scientist - GenAI USD 165K-185KAI Libraries | C++ | Computational modeling | Deep learning | Inference OptimizationMid-level Full TimePittsburgh, PA, United States16h ago
-
Software Engineer AI/ML USD 112K-150KA/B | A/B Testing | AWS | Anomaly Detection | Automated testingDental insurance | Employee assistance program | Health and wellness programs | Health insurance | Retirement benefitsMid-level Full TimeEvendale, United States R19h ago
-
Computer Scientist USD 78K-117KC++ | CI/CD | CUDA | Git | Linux401k matching | Educational reimbursement | Employee ownership | Health dental life and vision insurance | Pleasant work environmentEntry-level Full TimeDayton Office, United States19h ago
-
AI/ML | AWS | Agile | Amazon Web Services | Artificial IntelligenceSenior-level Full TimeUSA VA McLean - Customer Proprietary …19h ago
-
Embedded Firmware Software Engineer II – Rice Creek, MN USD 100K-150KBLE | Bluetooth Low Energy | C# | C++ | DebuggingMid-level Full TimeUSA-MN, United States19h ago
-
Forward Deployed AI Engineer (GenAI, AWS) USD 175K-200KAWS | AWS CDK | AWS Neptune | Amazon ECS | Amazon SageMakerRemote-friendly cultureSenior-level Full TimeNew Jersey20h ago
-
Jr. Software Engineer, Robot Systems USD 120K-135KBash | C++ | Computer Vision | Docker | Git401k plan | Commuter benefits | Dental insurance | Employee assistance program | Flexible PTOEntry-level Full TimeSeattle, WA21h ago
-
Imagery Product Engineer II- AI/Deep Learning USD 79K-133KAmazon AWS | C# | CI/CD | Databricks | Deep learning401k | Dental insurance | Health insurance | Life insurance | Paid HolidaysMid-level Full TimeRedlands, CA22h ago
-
Software Engineer, ML Data USD 180K-230KAWS | Apache Hive | Apache Spark | ClickHouse | GolangDental insurance | Equity | Health insurance | Hybrid work | Team gatherings once per quarterSenior-level Full TimeSan Francisco Bay Area22h ago
-
AI Software Engineer USD 127K-175KAPI Development | Agent Orchestration | Agent runtimes | Agent systems | C++Dental insurance | Employee assistance program | Flexible Paid Vacation | Flexible paid sick leave | Flexible spending accountEntry-level Full TimeSan Francisco, CA22h ago
-
Internship - Quantitative Trading USD 250K-290KAlgorithmic trading | C++ | Java | Mathematics | PythonBreakfast | Lunch | Onsite Barista | Onsite gym | Social eventsEntry-level InternshipAustin, TX; Chicago; New York1d ago
-
AI Ops Engineer USD 122K-191KAgent Development Kit | Agile | CI/CD | Cloud platform | DockerCareer coaching | Employee assistance programme | Flexible working hours | Global career opportunities | Hybrid workEntry-level Full TimeColorado, United States1d ago
-
Senior Embedded Software Engineer USD 165K-210KAutomated testing | C# | C++ | CAN | CAN DBCFlexible location within commuting distance | Hybrid workSenior-level Full TimePittsburgh, PA1d ago
-
Fall 2026 Intern, Analytics USD 34K-34KData Analysis | Data collection | Data organization | Database Management | ExcelHybrid work scheduleEntry-level InternshipChicago, Illinois, United States1d ago
-
Staff Software Engineer, Data USD 150K-206KAWS | Amazon ECS | Amazon EKS | Apache Airflow | Apache FlinkSenior-level Full TimeSunnyvale, CA, United States1d ago