Machine Learning System Software Engineer
Tasks
- Build inference engines
- Collaborate with compiler and hardware teams
- Define runtime interfaces
- Design accelerator driver stacks
- Develop ML runtimes
- Handle client lifecycle and crash recovery
- Implement model compilation pipelines
- Implement operator execution and tensor memory layouts
- Manage hardware priority and QoS
- Optimize neural network inference performance
- Optimize software-hardware interfaces
- Support multi client runtime arbitration
Perks/Benefits
- N/A
Skills/Tech-stack
Batching | C# | C++ | Command queues | DMA | Driver Development | Graph IR | Hardware Accelerator | IPC | Inference engine | Machine Learning | Memory layout | Metal | ONNX Runtime | Objective-C | Operator Execution | Pipelining | Priority QoS | RPC | Resource Lifecycle | Swift | Tensor Memory Layout | TensorRT | Vulkan | XLA
Education
Regions
Countries
States
Cities
Related jobs
-
Algorithms | Data Structures | Debugging | Java | JavaScriptOn-site work | Top Secret clearanceSenior-level Full TimeTysons, VA5h ago
-
Applied AI Software Engineer III USD 102K-210K.NET | AI Agent | AI agent orchestration | AWS | AWS BedrockSenior-level Full TimeDallas, Texas, United States; Hermitage, Tennessee, …7h ago
-
Lead AI Engineer USD 160K-213KAgentic Workflows | Artificial Intelligence | CI/CD | Data Engineering | LLM ApplicationsHybrid work model | In-office collaboration | Remote flexibilitySenior-level Full TimeTel Aviv-Yafo, Tel Aviv District, IL R7h ago
-
Solution Architect/Data Engineer USD 150K-170KAPI Design | API Integration | Apache Kafka | Apache Spark | Artificial Intelligence401k match | Dental insurance | Medical insurance | Paid time off | Professional development and career advancementSenior-level Full TimeUnited States-Illinois-Wood Dale8h ago
-
Alerting | Canary Deployment | Distributed Systems | High Availability | Machine LearningEntry-level Full TimeSan Jose, California, United States8h ago
-
Asynchronous execution | Benchmarking | CUDA | Cache optimization | Compilation OptimizationEntry-level Full TimeSan Jose, California, United States8h ago
-
C++ | CUDA | CUDA toolkit | Code generation | Computation SchedulingEntry-level Full TimeSan Jose, California, United States8h ago
-
Software Engineer Graduate (Data-Intelligent Creation-AI Platform-Global Vision Engineering) - 2027 Start USD 128K-316KAutomation | CI/CD | Computer Vision | Generative AI | Language ProcessingEntry-level Full TimeSan Jose, California, United States8h ago
-
Applied Machine Learning Production Engineer Graduate (AML-Production Engineer) - 2027 Start USD 128K-256KAutomation | C++ | Distributed Systems | Linux | MonitoringMentorship | Professional developmentEntry-level Full TimeSan Jose, California, United States8h ago
-
A/B | A/B Testing | ASIC | B testing | C#Entry-level InternshipSan Diego, California, United States8h ago
-
Anomaly Detection | Data Pipelines | LLM | Language Processing | Log AnalysisEntry-level InternshipSan Jose, California, United States8h ago
-
Big Data | C++ | Data Pipelines | Distributed Storage | JavaEntry-level Full TimeSeattle, Washington, United States9h ago
-
Advertising | Big Data | C++ | Data Pipelines | Distributed StorageEntry-level Full TimeSeattle, Washington, United States9h ago
-
Machine Learning Engineer Graduate (E-Commerce Recommendation/Search Alliance) - 2027 Start USD 115K-177KAlgorithms | Big Data | Big Data Engineering | Data Engineering | Data StructuresEntry-level Full TimeSeattle, Washington, United States9h ago
-
Machine Learning Engineer Graduate (E-Commerce Recommendation/Search Alliance) - 2027 Start (PhD) USD 129K-237KAlgorithms | Big Data | Big Data Engineering | Data Engineering | Data StructuresEntry-level Full TimeSeattle, Washington, United States9h ago
-
Machine Learning Engineer Graduate (E-Commerce Recommendation/Search Alliance) - 2027 Start USD 115K-177KAlgorithms | Big Data | Big Data Engineering | Data Engineering | Data StructuresEntry-level Full TimeSan Jose, California, United States9h ago
-
Machine Learning Engineer Graduate (E-Commerce Recommendation/Search Alliance) - 2027 Start (PhD) USD 129K-237KBig Data | Big Data Engineering | Data Engineering | Data Structures | Data structures algorithmsEntry-level Full TimeSan Jose, California, United States9h ago
-
Algorithms | C plus plus | Causal Inference | Data Structures | DebiasingEntry-level Full TimeSan Jose, California, United States9h ago
-
Machine Learning Engineer Graduate (E-Commerce Recommendation Live) - 2027 Start (PhD) USD 129K-246KAdvertising | Algorithms | C++ | Causal Inference | Contrastive LearningEntry-level Full TimeSeattle, Washington, United States9h ago
-
C++ | Causal Inference | Contrastive Learning | Debiasing | Deep learningEntry-level Full TimeSeattle, Washington, United States9h ago
-
Machine Learning Digital Design Engineer USD 142K-203KASIC design | CDC | Clock Domain | Clock Domain Crossing | Computer ArchitectureSenior-level Full TimeSunnyvale, CA10h ago
-
Security Engineer, Applied AI USD 147K-195KAWS | Adversarial research | Adversary simulation | Agent Orchestration | AndroidSenior-level Full TimeMenlo Park, CA | New York, …10h ago
-
Ads ML Developer Experience Tech Lead USD 174K-220KAI Agents | Agent Orchestration | Artificial Intelligence | Bias Mitigation | Build systemsSenior-level Full TimeSunnyvale, CA R10h ago
-
C++ | Compute Allocation | Dashboarding | Data Visualization | Machine LearningMid-level Full TimeMountain View, CA, USA; New York, …10h ago
-
Staff Software Engineer, Data Center Network Switches USD 207K-300KAI/ML | AI/ML Infrastructure | C++ | Data Structures | Data structures algorithmsSenior-level Full TimeSunnyvale, CA, USA10h ago