Senior System Software Engineer, Agentic Inference - Dynamo
Tasks
- Balance scalability performance and latency
- Build distributed inference frontend
- Contribute to disaggregated model serving
- Deliver day 0 support for new models
- Develop open source AI model inference software
- Innovate inference state management for long running agents
- Integrate open source technologies
- Load-balance asynchronous requests
- Optimize throughput under latency constraints
- Support agentic inference workloads
Perks/Benefits
- N/A
Skills/Tech-stack
Context Management | Debugging | Distributed Systems | GPU Memory Optimization | GPU memory | High Performance | High-performance networking | KV cache | Memory Optimization | Multimodal input | Performance Analysis | Prefix Cache | Python | Rust | Scheduling | Structured Output | Testing | Token Accounting | Tool-Calling
Education
Regions
Countries
States
Related jobs
-
CUDA | Huggingface | JAX | PyTorch | PythonSenior-level Full TimeUS, CA, Santa Clara R2d ago
-
Senior-level Full TimeUS, CA, Santa Clara R2d ago
-
Machine Learning Engineer, AI Safety USD 124K-195KBias Mitigation | Bias detection | Data Monitoring | Deep learning | KerasMid-level Full TimeUS, CA, Santa Clara R7d ago
-
C# | C++ | DRAM | Distributed Systems | GPUSenior-level Full TimeUS, CA, Santa Clara R7d ago
-
Principal Deep Learning Algorithm Engineer USD 272K-431KC++ | CUDA | Computer Architecture | Deep learning | GPU ProgrammingBenefits | EquitySenior-level Full TimeUS, CA, Santa Clara R9d ago
-
Senior Cloud Software Engineer, DGXC Data Services USD 152K-241KAPI Design | AWS | Algorithms | C++ | Data StructuresBenefits | EquitySenior-level Full TimeUS, CA, Santa Clara R9d ago
-
C++ | CUDA | Containerization | Distributed Systems | DockerSenior-level Full TimeUS, CA, Santa Clara R10d ago
-
C++ | Computer Vision | Curriculum learning | Data pipeline | Deep learningSenior-level Full TimeUS, CA, Santa Clara R11d ago
-
Senior Deep Learning Framework Communications Engineer USD 152K-241KC++ | CUDA | Communication overlap | Compiler optimization | Compute Communication OverlapSenior-level Full TimeUS, CA, Santa Clara R11d ago
-
C++ | CUDA | Distributed inference | GPU Architecture | Graph CompilerBenefits | EquitySenior-level Full TimeUS, CA, Santa Clara R11d ago
-
Senior Software Engineer, AI Storage USD 184K-287KAlgorithms | Bash | C# | C++ | CUDABenefits | EquitySenior-level Full TimeUS, CA, Santa Clara R11d ago
-
Bash | Bootstrap | CSI | CSS3 | Container StorageSenior-level Full TimeUS, CA, Santa Clara R12d ago
-
Senior Storage Production Engineer - DGX Cloud USD 176K-333KAccess Control | Alerting | Ansible | Auditing | BackupBenefits | Equity | On-call rotation supportSenior-level Full TimeUS, CA, Santa Clara R14d ago
-
C++ | CUDA | Computer Vision | Deep learning | Generative AIComprehensive benefits | Equity | Family benefitsSenior-level Full TimeUS, CA, Santa Clara R15d ago
-
Senior-level Full TimeUS, CA, Santa Clara R17d ago
-
Applied Agentic AI Lead, Partner Co-Design USD 224K-356KAgent systems | Compliance governance | Deep learning | Docker | Efficient Fine TuningEquity | Health benefits | Professional developmentSenior-level Full TimeUS, CA, Santa Clara R17d ago
-
C++ | Cache Management | Debugging | Distributed Systems | GPU memorySenior-level Full TimeUS, CA, Santa Clara R18d ago
-
Algorithms | Benchmarking | C++ | Capacity Planning | Code generationEquity | Health benefitsSenior-level Full TimeUS, CA, Santa Clara R18d ago