Inference Software Engineer
Tasks
- Build scale inference runtime
- Manage inference state and error handling
- Optimize multi node inference communication
- Optimize routing using collective communication
- Port machine learning models to custom architecture
- Profile performance and debug bottlenecks and correctness issues
Perks/Benefits
- Daily meals
- Housing subsidy
- Medical, dental & vision coverage
- Relocation support
- Unlimited compute budget
- Wellness benefits
Skills/Tech-stack
C++ | Compilers | Consensus Algorithms | Consistency models | Debugging | Distributed Systems | High speed | High-Speed Interconnects | Infiniband | JAX | Linux | Mixture of Experts | NVLink | Network Programming | Performance Profiling | PyTorch | Rust | SIMD | Transformer Architectures
Education
N/A
Regions
Countries
States
Cities
Related jobs
-
Security Engineer (Embedded & Networking) USD 130K-175KApplication Firewall | C# | C++ | Cloud Security | GoExtended hours weekends as needed | Onsite work requirementMid-level Full TimeCape Canaveral, FL11h ago
-
Security Engineer (Embedded & Networking) USD 130K-180KAPI | Access Control | Access Management | Application Firewall | Authentication401k plan | Dental coverage | Disability insurance | Employee stock purchase plan | Life insuranceMid-level Full TimeHawthorne, CA11h ago
-
Security Engineer (Embedded OT) USD 130K-180KAccess Control | Access Management | Application Firewall | Automation | Best practices401k retirement plan | Employee stock purchase plan | Health, dental, and vision insurance | Life insurance | Long-term disability insuranceMid-level Full TimeCape Canaveral, FL11h ago
-
Security Engineer (Embedded OT) USD 130K-180KAccess Control | Application Firewall | Authentication | Authorization | C#401k plan | Dental coverage | Disability insurance | Life insurance | Medical coverageMid-level Full TimeHawthorne, CA11h ago
-
C++ | Cloud Computing | Code Reviews | Deployment Automation | Distributed Systems401k match | Caregiving support | Family planning support | Flexible vacation | Gender-affirming careSenior-level Full TimeRemote - United States R12h ago
-
ARM | C Programming | Device Drivers | Encryption algorithms | EthernetBackground check clearance | Drug Test Clearance | Hybrid schedule | Onsite Days Per WeekMid-level Full TimeLos Angeles R12h ago
-
Senior AI/ML Engineer USD 152K-190KAmazon Web Services | CI/CD | Deep learning | Git | Machine LearningCaregiver support | Hybrid work | Work on site in the United StatesSenior-level Full TimeCambridge, MA, United States13h ago
-
Machine Learning Operations Engineer USD 133K-167KAWS SageMaker | Docker | GitHub Actions | Machine Learning | NumPyCareer development | Communities | Commuting cost coverage | Corporate giving programs | Daily free lunchMid-level Full TimeBoston, Massachusetts, United States R13h ago
-
Embedded Software Engineer USD 96K-134KARM | Board Support | Board Support Package | C# | Common CriteriaHybrid work schedule | Onsite Days Per WeekMid-level Full TimeLos Angeles R13h ago
-
Embedded Software Engineer USD 96K-134KARM | Authentication | C# | Common Criteria | Device DriversMid-level Full TimeIrvine CA13h ago
-
Senior Software Engineer, Robotic Solutions Development USD 174K-237KBazel | C++ | CAD | GRPC | GazeboSenior-level Full TimeMountain View, California14h ago
-
Embedded Software Engineer USD 170K-190KC++ | CAN | CI/CD | Cellular | Cloud Storage401k matching | Dental insurance | Health insurance | Paid Holidays | Paid parental leaveMid-level Full TimeHayward, CA14h ago
-
Senior Machine Learning Engineer USD 188K-282KAdversarial Training | Calibration monitoring | Continuous batching | DPO | Deep learningSenior-level Full TimePalo Alto, CA14h ago
-
Senior ML Engineer, Manipulation USD 150K-265KComputer Vision | Data Augmentation | Data pipeline | Dataset curation | Diffusion ModelsOnsite five days a weekSenior-level Full TimeSan Francisco14h ago
-
Senior ML Engineer, Foundation Models USD 150K-260KBehavior Cloning | Data Augmentation | DeepSpeed | Diffusion Models | Distributed TrainingHigh ownership team | Onsite work five days per week | Startup environmentSenior-level Full TimeSan Francisco15h ago
-
A/B | A/B Testing | Auction optimization | B testing | Causal InferenceCommute subsidy | Disability insurance | Employee assistance program | Employee resource groups | Employee stock ownershipEntry-level Full TimeNew York, NY, USA16h ago
-
A/B | A/B Testing | B testing | Causal Inference | Human FeedbackCommute subsidy | Comprehensive health insurance | Disability insurance | Employee assistance program | Employee resource groupsEntry-level Full TimeBellevue, WA, USA16h ago
-
A/B | A/B Testing | B testing | Causal Inference | Experimentation infrastructureCommute subsidy | Employee resource groups | Employee stock ownership | Generous vacation | Global employee assistance programEntry-level Full TimeMountain View, CA, USA16h ago
-
AI/ML Software Engineer USD 83K-83KAWS | Angular | Azure | CI/CD | Deep learning401k matching | Flex PTO | Hybrid work | Life insurance | Medical/Dental/Vision insuranceMid-level Full TimeBay Area, CA16h ago
-
AI Developer Experience Engineer USD 180K-250KAPI Development | Anthropic | Automation | Benchmarking | Data PipelinesSenior-level Full TimeNew York City17h ago
-
Senior Machine Learning Engineer, Reinforcement Learning USD 150K-250KDomain Randomization | Embedded Systems | Gazebo | Isaac-Gym | Mujoco401k retirement plan | Dental insurance | Employee referral bonus | Flexible PTO | Free lunchSenior-level Full TimeColumbus, Ohio or Remote R17h ago
-
Senior Software Engineer - Analytics Front Office USD 200K-250KAlgorithms | Asynchronous programming | C# | C++ | CI/CD401k | Dental insurance | Disability insurance | Flexible spending account | Health insuranceSenior-level Full TimeChicago, Greenwich, New York, Austin, Houston18h ago
-
Senior Engineer - Data Platform USD 148K-201KAirgapped environments | CI/CD | CRD | ConnectRPC | Consistency models401k retirement plan | Conference support | Dental insurance | Disability insurance | Flexible time offSenior-level Full TimeRemote, United States R18h ago
-
Senior Machine Learning Engineer USD 203K-267KAlgorithm Design | Artificial Intelligence | C# | Complexity analysis | Data PipelinesHybrid work model | Unlimited sick daysSenior-level Full TimeSeattle, Washington, United States18h ago
-
Associate Engineer - Data Platform USD 102K-138KAI Assisted Development | Command Line | Command-line Interface | Containerization | Docker401k retirement plan | Conferences travel lodging fees | Dental & vision insurance | Disability insurance | Flexible time offMid-level Full TimeRemote, United States R19h ago