Inference Software Engineer
Tasks
- Build scale inference runtime
- Manage inference state and error handling
- Optimize multi node inference communication
- Optimize routing using collective communication
- Port machine learning models to custom architecture
- Profile performance and debug bottlenecks and correctness issues
Perks/Benefits
- Daily meals
- Housing subsidy
- Medical, dental & vision coverage
- Relocation support
- Unlimited compute budget
- Wellness benefits
Skills/Tech-stack
C++ | Compilers | Consensus Algorithms | Consistency models | Debugging | Distributed Systems | High speed | High-Speed Interconnects | Infiniband | JAX | Linux | Mixture of Experts | NVLink | Network Programming | Performance Profiling | PyTorch | Rust | SIMD | Transformer Architectures
Education
N/A
Regions
Countries
States
Cities
Related jobs
-
Computer Vision | Fraud Detection | Language Processing | Machine Learning | Natural LanguageSenior-level Full TimeSeattle, Washington, United States5h ago
-
Senior Machine Learning Engineer USD 112K-183KAWS | Data Ingestion | Data Modeling | Data Quality | Data Visualization401k savings plan | Adoption benefits | Career development | Disability benefits | Employee assistance programSenior-level Full TimeMossville, Illinois, United States18h ago
-
Quantitative Developer Intern - Summer 2027 USD 175K-285KC++ | Data Analysis | Data Modeling | High Frequency | High-Frequency TradingCasual dress code | Free meals | Housing accommodation | Mentorship | Networking eventsEntry-level InternshipNew York, Chicago20h ago
-
Quantitative Trader - 2027 USD 150K-250KC plus plus | Data Analysis | Data Modeling | Linux | Machine LearningContinuous learning workshops | Fitness Events | Free meals | Hybrid work | Paid time offMid-level Full TimeNew York, Chicago20h ago
-
Senior Embedded Software Engineer USD 120K-160KAtlassian Confluence | Bare Metal | Bitbucket | C++ | Cameo401k employer match | Career growth | Employee assistance program | Low-cost medical dental vision | Paid HolidaysSenior-level Full TimePalmdale, CA; Fort Worth, TX20h ago
-
API Development | AWS | Amazon SageMaker | Automated testing | CI/CDFlexible work arrangements | Health, dental, vision coverage | Hybrid work arrangement | Innovation opportunities | Internal mobilitySenior-level Full TimeCanada20h ago
-
API Testing | AWS | Agile | Bias detection | CI/CDCollaborative engineering environment | Comprehensive benefits | Professional growthMid-level Full TimeBaltimore, MD, United States1d ago
-
AI Agents | Data Processing | Debugging | Distributed Systems | Language Processing401k matching | Career growth | Dental insurance | Health insurance | Life insuranceMid-level Full TimeSan Francisco, California, United States1d ago
-
Asynchronous programming | Debugging | Language Processing | Natural Language | Natural Language Processing401k matching | Career growth | Dental insurance | Employee discount programs | Health insuranceMid-level Full TimeSan Francisco, California, United States1d ago
-
APIs | Data Engineering | Distributed Systems | Inference Pipelines | JAXMid-level Full TimeSan Francisco, California, United States1d ago
-
Embedded Software Engineer - Special Purpose Software USD 108K-160KARM Cortex | ARM Cortex-M | C++ | CAN | Cortex-M401k match | Employee stock purchase plan | Health care benefits | Life insurance | Long-term disabilityMid-level Full TimeSanta Cruz, CA, United States1d ago
-
APIs | AWS | Add-ons | Ansible | AppDynamicsSenior-level Full TimeHerndon, Virginia, United States1d ago
-
AI/Machine Learning Engineer USD 130K-177KAWS | Apache Spark | Azure AI | Azure Machine Learning | DatabricksMid-level Full TimeCarmel, Indiana- Hybrid OR St. Louis, … R1d ago
-
Senior Machine Learning Engineer - Agentic Workflow USD 145K-196KAWS | Async API | CI/CD | Distributed Systems | DockerSenior-level Full TimeHouston, TX, United States1d ago
-
Robotics Software Engineer USD 155K-300KC++ | Device Drivers | EBPF | GPU Profiling | Kernel programmingSenior-level Full TimeSan Francisco1d ago
-
Embedded Engineer USD 175K-280KAOSP | Bare Metal | Bluetooth | Bootloader | C#401k match | Employee assistance program | Flexible spending account | Health, dental, vision coverage | Stock optionsSenior-level Full TimeSan Francisco1d ago
-
Space Operations Engineer (Embedded Software) USD 119K-160KARM | C# | C++ | Command and control | Communication ProtocolsMid-level Full TimeSan Francisco, CA1d ago
-
Senior/Staff Machine Learning Engineer, Planning USD 160K-220KC++ | Cloud Computing | Data Ingestion | Deep learning | Experimentation401k plan | Free lunch | Professional development | Unlimited snacks and beveragesSenior-level Full TimeSanta Clara, CA1d ago
-
Mechatronic/Robotics Engineer or Systems Integration Engineer - Camera and Sensor Calibration USD 120K-190KAutomation systems | Bash | C++ | Camera Calibration | Control SystemsOn-site workMid-level Full TimeMountain View, CA1d ago
-
Staff AI engineer USD 170K-250KAI Model Evaluation | AI model | AWS | Agent Orchestration | CachingFlexible working hours | Hybrid work culture | Unlimited time offSenior-level Full TimeSan Francisco1d ago
-
Senior Quantum Embedded Engineer USD 142K-175K10G Ethernet | AMD Xilinx | Bash | C/C++ | CI toolsHybrid work | Remote workSenior-level Full TimeNew Haven, CT1d ago
-
Senior Quantum Applications Engineer - QEC USD 119K-258KCUDA-Q | Docker | End to End | End-to-End Testing | Error correctionSenior-level Full TimeNew Haven, CT1d ago
-
Senior-level Full TimeWatertown, MA1d ago
-
1.51 Robotics Autonomy Engineer - Locomotion USD 70K-300KAdaptive Control | C++ | Contact dynamics | Control Theory | Domain RandomizationMid-level Full TimeIrvine, CA1d ago
-
Engineer II, Data Engineering USD 115K-135KData Quality | Data Warehousing | Druid | ETL | Git401k match | Cell phone subsidy | Employee stock purchase plan | Fitness reimbursement | Healthcare coverageSenior-level Full TimeColorado - Broomfield, United States R1d ago