Machine Learning System Software Engineer
Tasks
- Build inference engines
- Collaborate with compiler and hardware teams
- Define runtime interfaces
- Design accelerator driver stacks
- Develop ML runtimes
- Handle client lifecycle and crash recovery
- Implement model compilation pipelines
- Implement operator execution and tensor memory layouts
- Manage hardware priority and QoS
- Optimize neural network inference performance
- Optimize software-hardware interfaces
- Support multi client runtime arbitration
Perks/Benefits
- N/A
Skills/Tech-stack
Batching | C# | C++ | Command queues | DMA | Driver Development | Graph IR | Hardware Accelerator | IPC | Inference engine | Machine Learning | Memory layout | Metal | ONNX Runtime | Objective-C | Operator Execution | Pipelining | Priority QoS | RPC | Resource Lifecycle | Swift | Tensor Memory Layout | TensorRT | Vulkan | XLA
Education
Regions
Countries
States
Cities
Related jobs
-
Project GenAI Engineer III USD 113K-188KAWS | Bedrock | Data Management | Fine Tuning | Generative AISenior-level Full TimeRosslyn, Virginia, United States7h ago
-
Principal Engineer - Future of Engineering AI Solutions USD 125K-183KAPIs | Access Control | Agent Frameworks | Agentic AI | Artificial IntelligenceSenior-level Full TimeNovi - Michigan, USA - Cabot …8h ago
-
Algorithms | C++ | CUDA | Computer Systems | Continuous batchingDevelopment workshops | Hands-on experience | Industry exposure | Learning programs | Social eventsEntry-level InternshipSan Jose, California, United States9h ago
-
Research Scientist / Software Engineer, LLM/Agent Platform - TikTok - Content Ecology AI Innovation & Platform USD 160K-230KAccelerator optimization | Deep learning | DeepSpeed | Distributed Systems | Evaluation FrameworksSenior-level Full TimeSan Jose, California, United States9h ago
-
C++ | Data Processing | Debugging | Entity Extraction | Fine TuningSenior-level Full TimeMountain View, CA, USA10h ago
-
BLE | C# | C++ | CSI2 | Convolutional Neural NetworksSenior-level Full TimeSan Jose, CA, USA10h ago
-
Autonomous Agents | Computer Vision | Data Processing | Data Structures | Data Structures and AlgorithmsSenior-level Full TimeSunnyvale, CA, USA; Kirkland, WA, USA10h ago
-
Software Engineer, Embedded Systems, Pixel Touch USD 174K-252KAIDL | Algorithms | Android framework | C# | C++Mid-level Full TimeMountain View, CA, USA10h ago
-
Practice Customer Engineer, Data Analytics, Google Cloud USD 152K-221KAlooma | Apache Spark | Architecture Design | Batch Processing | Big DataSenior-level Full TimeMountain View, CA, USA; Boulder, CO, …10h ago
-
AOSP | Abstraction layer | Android | Android Hardware Abstraction Layer | Android hardwareBonus | Equity | Health insurance | Paid time off | Professional developmentSenior-level Full TimeMountain View, CA, USA10h ago
-
Staff Software Engineer, Data Protection USD 207K-300KArtificial Intelligence | C++ | Data Governance | Data Privacy | Data StorageBonus | Equity | Health insurance | Paid time offSenior-level Full TimeSan Jose, CA, USA10h ago
-
Software Engineer, Generative AI, Maps USD 147K-210KComputer Geometry | Computer Vision | Convex Optimization | Data Processing | Data StructuresMid-level Full TimeMountain View, CA, USA10h ago
-
Dev and AI Infra Software Engineer, Releases, XR USD 207K-300KAI Software Engineering | AI software | Automation frameworks | Bug detection | Build AutomationSenior-level Full TimeSan Jose, CA, USA10h ago
-
Staff ML Engineer, Search Ads Auto-Bidding USD 207K-300KC++ | Deep learning | Experiment design | Keras | Language ModelsSenior-level Full TimeNew York, NY, USA10h ago
-
Staff Software Engineer, Workspace Editors, Documents AI USD 207K-300KComputer Vision | Data Processing | Deep learning | Fine Tuning | Generative AISenior-level Full TimeNew York, NY, USA10h ago
-
Cyber Software Engineer Staff (Embedded) USD 120K-224KBlue Team | C++ | CISSP | Code Analysis | Cybersecurity401k match | Education assistance | Employee assistance program | Flexible spending accounts | Flexible work schedulesSenior-level Full TimeOrlando, FL, US16h ago
-
Scientific Computing Engineer USD 143K-264KC# | C++ | CUDA | Finite Difference Method | Finite Volume MethodMid-level Full TimeCupertino18h ago
-
Senior Machine Learning Engineer, Payments USD 191K-223KAirflow | Anomaly Detection | Data Processing | Deep learning | Fine TuningSenior-level Full TimeRemote-USA R18h ago
-
AI Engineer (Early Career) USD 50K-120KAI Agents | JavaScript | Language Models | Large Language Models | Machine LearningEntry-level Full TimeSan Francisco Bay Area19h ago
-
AI Agent Tech Lead USD 150K-208KAI Agent | AI Agent Frameworks | API Development | Agent Frameworks | Artificial IntelligenceSenior-level Full TimeSan Francisco Bay Area19h ago
-
Data Engineer, Hardware Reliability (Starlink) USD 135K-185KBash | C# | C++ | Concurrency | Data InfrastructureExtended hours and weekends | Onsite work required | Travel up to 10%Mid-level Full TimeBastrop, TX R21h ago
-
Apache Airflow | Apache Flink | Apache Iceberg | Apache Kafka | Apache Spark401k employer match | Comprehensive healthcare benefits | Family planning support | Flexible vacation | Gender-affirming careSenior-level Full TimeRemote - United States R21h ago
-
Software Engineer II - Embedded Networking, Amazon Leo USD 165K-223KC# | C++ | CI/CD | Code review | Design Patterns401k matching | Employee assistance program | Flexible spending accounts | Health insurance | Mental health supportMid-level Full TimeSunnyvale, California, USA21h ago
-
AI Engineer USD 130K-170KClaims data | Data Preprocessing | Data Transformation | Data Visualization | Data cleaning401k match | Disability insurance | Employee wellness program | Health insurance | Life insuranceSenior-level Full TimeWarren, NJ, United States21h ago
-
Mid-level Full TimeUnited States21h ago