Inference Software Engineer
Tasks
- Build scale inference runtime
- Manage inference state and error handling
- Optimize multi node inference communication
- Optimize routing using collective communication
- Port machine learning models to custom architecture
- Profile performance and debug bottlenecks and correctness issues
Perks/Benefits
- Daily meals
- Housing subsidy
- Medical, dental & vision coverage
- Relocation support
- Unlimited compute budget
- Wellness benefits
Skills/Tech-stack
C++ | Compilers | Consensus Algorithms | Consistency models | Debugging | Distributed Systems | High speed | High-Speed Interconnects | Infiniband | JAX | Linux | Mixture of Experts | NVLink | Network Programming | Performance Profiling | PyTorch | Rust | SIMD | Transformer Architectures
Education
N/A
Regions
Countries
States
Cities
Related jobs
-
Security Engineer (Embedded & Networking) USD 130K-175KApplication Firewall | C# | C++ | Cloud Security | GoExtended hours weekends as needed | Onsite work requirementMid-level Full TimeCape Canaveral, FL12h ago
-
Security Engineer (Embedded & Networking) USD 130K-180KAPI | Access Control | Access Management | Application Firewall | Authentication401k plan | Dental coverage | Disability insurance | Employee stock purchase plan | Life insuranceMid-level Full TimeHawthorne, CA12h ago
-
Security Engineer (Embedded OT) USD 130K-180KAccess Control | Access Management | Application Firewall | Automation | Best practices401k retirement plan | Employee stock purchase plan | Health, dental, and vision insurance | Life insurance | Long-term disability insuranceMid-level Full TimeCape Canaveral, FL12h ago
-
Security Engineer (Embedded OT) USD 130K-180KAccess Control | Application Firewall | Authentication | Authorization | C#401k plan | Dental coverage | Disability insurance | Life insurance | Medical coverageMid-level Full TimeHawthorne, CA12h ago
-
C++ | Cloud Computing | Code Reviews | Deployment Automation | Distributed Systems401k match | Caregiving support | Family planning support | Flexible vacation | Gender-affirming careSenior-level Full TimeRemote - United States R13h ago
-
ARM | C Programming | Device Drivers | Encryption algorithms | EthernetBackground check clearance | Drug Test Clearance | Hybrid schedule | Onsite Days Per WeekMid-level Full TimeLos Angeles R14h ago
-
Senior AI/ML Engineer USD 152K-190KAmazon Web Services | CI/CD | Deep learning | Git | Machine LearningCaregiver support | Hybrid work | Work on site in the United StatesSenior-level Full TimeCambridge, MA, United States14h ago
-
Machine Learning Operations Engineer USD 133K-167KAWS SageMaker | Docker | GitHub Actions | Machine Learning | NumPyCareer development | Communities | Commuting cost coverage | Corporate giving programs | Daily free lunchMid-level Full TimeBoston, Massachusetts, United States R15h ago
-
Embedded Software Engineer USD 96K-134KARM | Board Support | Board Support Package | C# | Common CriteriaHybrid work schedule | Onsite Days Per WeekMid-level Full TimeLos Angeles R15h ago
-
Embedded Software Engineer USD 96K-134KARM | Authentication | C# | Common Criteria | Device DriversMid-level Full TimeIrvine CA15h ago
-
Senior Software Engineer, Robotic Solutions Development USD 174K-237KBazel | C++ | CAD | GRPC | GazeboSenior-level Full TimeMountain View, California15h ago
-
Embedded Software Engineer USD 170K-190KC++ | CAN | CI/CD | Cellular | Cloud Storage401k matching | Dental insurance | Health insurance | Paid Holidays | Paid parental leaveMid-level Full TimeHayward, CA15h ago
-
Senior Machine Learning Engineer USD 188K-282KAdversarial Training | Calibration monitoring | Continuous batching | DPO | Deep learningSenior-level Full TimePalo Alto, CA16h ago
-
Senior ML Engineer, Manipulation USD 150K-265KComputer Vision | Data Augmentation | Data pipeline | Dataset curation | Diffusion ModelsOnsite five days a weekSenior-level Full TimeSan Francisco16h ago
-
Senior ML Engineer, Foundation Models USD 150K-260KBehavior Cloning | Data Augmentation | DeepSpeed | Diffusion Models | Distributed TrainingHigh ownership team | Onsite work five days per week | Startup environmentSenior-level Full TimeSan Francisco16h ago
-
A/B | A/B Testing | Auction optimization | B testing | Causal InferenceCommute subsidy | Disability insurance | Employee assistance program | Employee resource groups | Employee stock ownershipEntry-level Full TimeNew York, NY, USA17h ago
-
A/B | A/B Testing | B testing | Causal Inference | Human FeedbackCommute subsidy | Comprehensive health insurance | Disability insurance | Employee assistance program | Employee resource groupsEntry-level Full TimeBellevue, WA, USA17h ago
-
A/B | A/B Testing | B testing | Causal Inference | Experimentation infrastructureCommute subsidy | Employee resource groups | Employee stock ownership | Generous vacation | Global employee assistance programEntry-level Full TimeMountain View, CA, USA17h ago
-
AI/ML Software Engineer USD 83K-83KAWS | Angular | Azure | CI/CD | Deep learning401k matching | Flex PTO | Hybrid work | Life insurance | Medical/Dental/Vision insuranceMid-level Full TimeBay Area, CA18h ago
-
AI Developer Experience Engineer USD 180K-250KAPI Development | Anthropic | Automation | Benchmarking | Data PipelinesSenior-level Full TimeNew York City18h ago
-
Principal Embedded Software Engineer II USD 140K-193KAPI Design | ARM | C# | C++ | Configuration ManagementDental insurance | Disability insurance | FSA | HSA | Health insuranceSenior-level Full TimeAustin, TX18h ago
-
Senior Machine Learning Engineer, Reinforcement Learning USD 150K-250KDomain Randomization | Embedded Systems | Gazebo | Isaac-Gym | Mujoco401k retirement plan | Dental insurance | Employee referral bonus | Flexible PTO | Free lunchSenior-level Full TimeColumbus, Ohio or Remote R18h ago
-
Software Engineer, Perception USD 191K-253K3D Reconstruction | C++ | CUDA | Change detection | Computer VisionHealth benefits | Relocation benefitsMid-level Full TimeCosta Mesa, California, United States18h ago
-
Senior Software Engineer - Analytics Front Office USD 200K-250KAlgorithms | Asynchronous programming | C# | C++ | CI/CD401k | Dental insurance | Disability insurance | Flexible spending account | Health insuranceSenior-level Full TimeChicago, Greenwich, New York, Austin, Houston19h ago
-
Senior Engineer - Data Platform USD 148K-201KAirgapped environments | CI/CD | CRD | ConnectRPC | Consistency models401k retirement plan | Conference support | Dental insurance | Disability insurance | Flexible time offSenior-level Full TimeRemote, United States R20h ago