Senior Solutions Architect, Inference Service Providers
Tasks
- Accelerate inference pipelines
- Build and operate inference recipes
- Collaborate with inference partners
- Evangelize DevOps best practices
- Guide deployment of disaggregated inference systems
- Provide technical mentorship and leadership
- Resolve complex partner issues
Perks/Benefits
- N/A
Skills/Tech-stack
Agent Design | Cache Management | Custom Inference Kernels | Data Curation | DevOps | Disaggregated serving | Grove | Inference Server | KV cache | KV-cache management | Kernel optimization | Kubernetes | Memory systems | Model Evaluation | Model Optimization | Model Serving | Multi Tier KV Cache | Multi-tier | NIXL | NVIDIA Triton | NVIDIA Triton Inference | NVIDIA Triton Inference Server | Nvidia Dynamo | Observability | Quantization | Retrieval systems | Routing | SGLang | Sandboxing | Speculative decoding | TensorRT-LLM | Triton Inference Server | VLLM
Education
Roles
Architect | Engineer | Solutions Architect | Solutions Engineer
Regions
Countries
States
Related jobs
-
Senior Software Engineer, RL Post-Training Frameworks USD 184K-287KActor Based Programming | C# | C++ | Deep learning | Distributed SystemsSenior-level Full TimeUS, CA, Santa Clara R3d ago
-
Senior-level Full TimeUS, CA, Santa Clara R4d ago
-
Senior AI Infrastructure Software Engineer - DGX Cloud USD 184K-287KC# | C++ | Cause analysis | Debugging | Distributed SystemsBenefits | EquitySenior-level Full TimeUS, CA, Santa Clara R4d ago
-
Senior Deep Learning Algorithm Engineer USD 184K-287KCPU architecture | Distributed Computing | GPU Architecture | Generative AI | JAXEquity | Health benefitsSenior-level Full TimeUS, CA, Santa Clara R10d ago
-
C++ | CUDA | Docker | Infiniband | JAXSenior-level Full TimeUS, CA, Santa Clara R10d ago
-
Distinguished Engineer, Scaled Out Inferencing USD 320K-488KAI infrastructure | CUDA | Cloud Native | Cloud Native Architecture | Container OrchestrationSenior-level Full TimeUS, CA, Santa Clara R13d ago
-
Software Engineer, CUDA Deep Learning Systems USD 152K-258KC++ | CUDA | Computer Architecture | Deep learning | Distributed ComputingBenefits | EquityMid-level Full TimeUS, CA, Santa Clara R13d ago
-
Senior Solutions Architect, Industrial Robotics USD 184K-287KAI | Computer Vision | Data Generation | Deep learning | Digital TwinsSenior-level Full TimeUS, CA, Santa Clara R14d ago
-
Senior Solutions Architect, Industrial Robotics USD 184K-287KArtificial Intelligence | Computer Vision | Data Generation | Deep learning | Digital TwinEquity | Health insurance | Paid time offSenior-level Full TimeUS, CA, Santa Clara R14d ago
-
C++ | CUDA | CUPTI | Continuous batching | KV cacheSenior-level Full TimeUS, CA, Santa Clara R18d ago
-
AWS | Azure | Bazel | C# | C++Equity | Hybrid workSenior-level Full TimeUS, CA, Santa Clara R18d ago
-
C# | C++ | Caching | Distributed Systems | GPU ArchitectureComprehensive benefits | EquitySenior-level Full TimeUS, CA, Santa Clara R19d ago
-
Senior Software Engineer – TensorRT Edge-LLM USD 152K-241KAttention | C++ | CUDA | Compiler optimization | FlashInferSenior-level Full TimeUS, CA, Santa Clara R19d ago
-
Senior Software Engineer, CUDA Deep Learning Systems USD 184K-356KC++ | CUDA | Computer Architecture | Deep Learning Compilers | Deep learningBenefits | EquitySenior-level Full TimeUS, CA, Santa Clara R19d ago
-
Senior Deep Learning Algorithm Engineer USD 152K-241KAutoscaling | C++ | Deep learning | Distributed Systems | Inference OptimizationSenior-level Full TimeUS, CA, Santa Clara R19d ago
-
Senior Storage Production Engineer - DGX Cloud USD 184K-333KAccess Control | Anomaly Detection | Ansible | Auditing | BashSenior-level Full TimeUS, CA, Santa Clara R19d ago
-
Bash | Bootstrap | CSI | CSS3 | Container StorageSenior-level Full TimeUS, CA, Santa Clara R20d ago
-
Senior Deep Learning Frameworks CUDA Software Engineer USD 184K-356KC++ | CUDA | Distributed machine learning | HPC | JAXSenior-level Full TimeUS, CA, Santa Clara R21d ago
-
Senior Deep Learning Framework Communications Engineer USD 184K-287KC++ | CUDA | CuTe | Elasticity | Fault ToleranceBenefits | EquitySenior-level Full TimeUS, CA, Santa Clara R21d ago
-
Senior Cloud Software Engineer, DGXC Data Services USD 152K-241KAPI Design | Algorithms | Amazon Web Services | C++ | CheckpointsEquity | Health benefitsSenior-level Full TimeUS, CA, Santa Clara R22d ago
-
Senior Solutions Architect, Generative AI USD 184K-287KCollective communication | Congestion Control | Containers | DCGM | Data PipelinesConferencing Tools Access | Occasional travel | Remote workSenior-level Full TimeUS, CA, Santa Clara R25d ago
-
Senior Platform AI Engineer USD 184K-287KAuthentication | Authorization | Backend Infrastructure | C# | C++Senior-level Full TimeUS, CA, Santa Clara R27d ago
-
Asynchronous programming | Context Management | Deep learning | Distributed Systems | GPUSenior-level Full TimeUS, CA, Santa Clara R28d ago