Inference Intern
Tasks
- Add robust error handling
- Build programming abstractions for model porting
- Build runtime for transformer inference
- Co-design hardware instructions and model operations
- Debug performance and correctness issues
- Develop testing capabilities for model porting
- Enhance intra node execution
- Enhance multi node inference
- Implement high performance software components for model toolkit
- Implement state management
- Optimize routing and communication layers
- Perform performance profiling
- Support model porting to accelerator architecture
- Use collective communication for inference performance
Perks/Benefits
Skills/Tech-stack
C++ | Collective communication | Compilers | Consensus Protocols | Consistency models | Debugging | Distributed Systems | Error Handling | High speed | High-speed interconnect | Infiniband | Intra Node Execution | JAX | Kernel Networking | Linux | MOE | Mixture of Experts | Multi node inference | Multi-node | NVLink | Performance Profiling | PyTorch | Python | Rust | SGLang | SIMD | State management | Transformer Architecture | User Space Networking | User space | VLLM
Education
Regions
Countries
States
Cities
Related jobs
-
Software Engineer - TikTok AI Search Infrastructure USD 212K-389KAlgorithm Design | C++ | DAG | Data Architecture | Data ProcessingSenior-level Full TimeSan Jose, California, United States3h ago
-
Machine Learning Engineer / AI Model Developer (Mid to Senior)(Top Secret Clearance Required) (Hybrid) USD 78K-176KAPIs | Agile methodologies | Backend Development | Cloud Computing | Data Preparation401k | Employee discount program | Employee referral rewards | Flexible spending account | Flexible work scheduleMid-level Full TimeFort Belvoir, VA, US R4h ago
-
Software Engineer, Systems ML Engineering USD 170K-251KAlerting | Benchmarking | C++ | CUDA | DashboardingSenior-level Full TimeSunnyvale, CA | Bellevue, WA | …4h ago
-
Forward Deployed Engineer III, Google Cloud, Applied AI USD 174K-253KAPI Integration | Agent systems | Agentic Workflows | Chatbots | Cloud platformBenefits | Bonus | Equity | Travel up to 50 percentSenior-level Full TimeSan Francisco, CA, USA; Atlanta, GA, …4h ago
-
Research Software Engineer, Multimodal AI USD 174K-253KAgent Orchestration | Audio | C++ | Few-Shot Learning | Few-shotMid-level Full TimeSan Jose, CA, USA4h ago
-
Senior Software Engineer, AI/ML, Geo and Gemini App USD 174K-253KA/B | A/B Testing | B testing | C++ | Data AnalysisSenior-level Full TimeNew York, NY, USA4h ago
-
Bigtable | C++ | Colossus | Data Processing | Data StorageSenior-level Full TimeMountain View, CA, USA4h ago
-
Senior Software Engineer, AI/ML, Ads Training USD 174K-253KC++ | Distributed Systems | GPU | JAX | Machine LearningSenior-level Full TimeMountain View, CA, USA4h ago
-
Software Engineer, Product USD 208K-269KAgentic Frameworks | Anthropic | Claude Code | Cursor | DocumentationDental insurance | Health insurance | Paid time off | Retirement plan | Vision insuranceMid-level Full TimeSan Francisco, CA9h ago
-
Lead Software Engineer - Applied AI ML Lead USD 170K-195KApache Airflow | Apache Iceberg | Apache Kafka | Apache Spark | Automated testingBackup childcare | Financial coaching | Health care coverage | Mental health support | On-site health and wellness centersSenior-level Full TimePalo Alto, CA, United States14h ago
-
Forward Deployed AI Engineer USD 180K-230KAPI | AWS | Azure | CI/CD | Cloud platform5-day workweek | Collaborative work culture | Flexible working hours | Supportive work environmentSenior-level Full TimeNew York, New York, United States15h ago
-
AI Engineer (Temporary) USD 85K-95KAWS | Agents SDK | Anthropic API | Azure | Data RiskAccess to training and enablement resources | Hybrid work environment | Temporary contract with benefitsEntry-level Full Time TemporaryIthaca (Main Campus), United States16h ago
-
Sr. Embedded Software/Firmware Engineer USD 180K-240KARM | ASPICE | AUTOSAR | C# | C++Competitive compensation | Dental insurance | Flexible hours | Medical insurance | Pre-IPO stock optionsSenior-level Full TimeUnited States - Remote R16h ago
-
AI Engineer USD 105K-115KAPI Cost Modeling | API Integration | API Wrappers | Anthropic API | Conversation DesignCalm health employee membership | Company social events | Comprehensive benefits package | Employee referral incentive program | Employee resource groupsEntry-level Full TimeCincinnati, OH, US16h ago
-
Gen AI - CVS - Dallas USD 36K-126KAPI Gateway | Aiohttp | Amazon Web Services | Asyncio | CI/CD401k retirement plan | Medical, dental, vision benefits | Paid Holidays | Paid time off | Variable pay/incentivesMid-level Full TimeUnited States17h ago
-
Sr. Software Engineer, AI Infrastructure USD 144K-236KApache Beam | Apache Flink | Apache Spark | C# | C++Career development | Hybrid work | Stock grantsSenior-level Full TimeSunnyvale, CA, United States17h ago
-
Software Engineer, Algorithms (SDE) USD 150K-220KAI tools | C++ | Concurrency | Digital Signal | Digital Signal ProcessingSenior-level Full TimeCupertino17h ago
-
Senior Robotics Software Engineer USD 113K-151K3D simulation | AI | API Development | Agile | C++In-person office work | Lab workSenior-level Full TimeAustin, Texas, United States18h ago
-
Sr. Engineer, Firmware & Embedded Software USD 79K-158KAgile | Azure DevOps | BDM | Bare Metal | BootloaderOccasional travel for onboarding | Remote work within the United StatesSenior-level Full TimeFlorida, United States R18h ago
-
AI Research Engineer Intern USD 62K-96KAutonomous Driving | Causal AI | Computer Vision | Deep learning | Edge AIHoliday pay | Medical/Dental/Vision insurance | Sick leaveEntry-level InternshipSan Jose, CALIFORNIA, United States18h ago
-
Senior Software Engineer; Analytics Infrastructure USD 167K-230KAPI Design | Backend Engineering | Caching | Columnar Databases | Data ModelingBack up child care support | Employee stock purchase program ESPP | Flexible time off | Home office & equipment stipend | Learning and development stipendSenior-level Full TimeSan Francisco, CA18h ago
-
Data Science Intern | Fully Remote US USD 50K-70KAgentic Evaluation | Agentic Workflows | Data Analysis | Deep learning | Fine TuningBYOD policy | Equal opportunity employment | Fully remoteEntry-level Internship Part TimeSandy, UT, United States R19h ago
-
Staff Software Engineer, Data Integrations USD 210K-275KAlerting | Concurrency | Container Orchestration | DNS | DashboardsSenior-level Full TimeMountain View, CA19h ago
-
Senior Software Engineer, MLOps USD 175K-220KAgile | Batch Processing | Consistency guarantees | Data Modeling | Data Pipelines401k match | Charitable donation match | Commuter benefits | Dental insurance | Flexible time offSenior-level Full TimeRemote - United States R19h ago
-
AI | Application Programming | Application Programming Interfaces | Backend Development | Cloud ComputingFlexible-hybrid work | Hybrid schedule 3 days on site per weekSenior-level Full TimeSan Francisco, CA20h ago