Senior System Software Engineer - Dynamo-Triton Inference Server
Tasks
- Build robust software for production servers and cloud environments
- Contribute to feature development and customer adoption
- Contribute to open source deep learning software
- Debug and analyze software performance
- Design and implement tests
- Develop GPU accelerated AI inference serving software
- Develop and adopt next generation inference technologies
- Optimize prediction throughput and latency
- Unify Triton Inference Server and NVIDIA Dynamo stacks
Perks/Benefits
Skills/Tech-stack
C++ | Cache Management | Distributed Systems | GPU memory | GPU memory management | High Performance | High-performance networking | Inference Server | ML Systems | Memory Management | ONNX | OpenVINO | PyTorch | Python | Rust | TRT-LLM | TensorRT | Triton Inference | Triton Inference Server | VLLM
Education
Regions
Countries
States
Related jobs
-
Senior Software Engineer - Storage USD 152K-287KAmazon Web Services | Automation | Azure | BeeGFS | C++Senior-level Full TimeUS, CA, Santa Clara R1d ago
-
Senior Software Engineer, Agentic Engineering USD 184K-356KAgent Orchestration | Autonomous Search | CI/CD | Compiler infrastructure | Deep learningSenior-level Full TimeUS, CA, Santa Clara R3d ago
-
Senior Software Engineer, DGXC Data Services USD 152K-287KAWS | Algorithms | Apache Iceberg | Apache Spark | AzureEmployee benefits | EquitySenior-level Full TimeUS, CA, Santa Clara R8d ago
-
Bash | Bootstrap | CSI | CSS3 | Container StorageSenior-level Full TimeUS, CA, Santa Clara R11d ago
-
Senior Software Engineer, AI Storage USD 184K-287KAlgorithms | Bash | C++ | CUDA | CloudBenefits | EquitySenior-level Full TimeUS, CA, Santa Clara R11d ago
-
Senior Deep Learning Framework Communications Engineer USD 152K-287KC++ | CUDA | CUDA kernels | CuTe | Distributed TrainingBenefits | EquitySenior-level Full TimeUS, CA, Santa Clara R13d ago
-
C++ | CUDA | Docker | Infiniband | JAXSenior-level Full TimeUS, CA, Santa Clara R14d ago
-
Senior Deep Learning Frameworks CUDA Software Engineer USD 184K-356KAutograd | C++ | CUDA | Compiler technology | Computer ArchitectureSenior-level Full TimeUS, CA, Santa Clara R17d ago
-
Senior Scientific Machine Learning Engineer – Earth-2 USD 152K-287KCUDA | Containers | Data parallelism | Diffusion Models | GPU KernelBenefits | EquitySenior-level Full TimeUS, CA, Santa Clara R19d ago
-
Senior Storage Production Engineer - DGX Cloud USD 176K-333KAI/ML | Access Control | Algorithms | Ansible | AuditingBenefits | Equity | On-call rotationSenior-level Full TimeUS, CA, Santa Clara R19d ago