Senior AI Infrastructure Software Engineer - DGX Cloud
Tasks
- Define reliability metrics for system and service reliability
- Design and implement APIs for resiliency integration
- Develop platform and tools for large scale AI and LLM infrastructure
- Enhance infrastructure for AI platforms
- Monitor and improve system reliability
- Optimize AI workload efficiency and resiliency
- Root cause and analyze failures
- Triage failures from application to hardware
Perks/Benefits
Skills/Tech-stack
AI Inference | AI Training | C++ | Cause analysis | Data Infrastructure | Debugging | Distributed Systems | ELK | Elasticsearch | Golang | IB | JAX | Kubernetes | Linux | Logging | Loki | Monitoring | NCCL | Observability | Performance optimization | Prometheus | PyTorch | Python | RDMA | Ray | Root Cause Analysis | Root cause | TensorFlow
Education
Regions
Countries
States
Related jobs
-
C++ | CUDA | CUPTI | Continuous batching | KV cacheSenior-level Full TimeUS, CA, Santa Clara R2d ago
-
AWS | Azure | Bazel | C# | C++Equity | Hybrid workSenior-level Full TimeUS, CA, Santa Clara R2d ago
-
C# | C++ | Caching | Distributed Systems | GPU ArchitectureComprehensive benefits | EquitySenior-level Full TimeUS, CA, Santa Clara R2d ago
-
Senior Software Engineer – TensorRT Edge-LLM USD 152K-241KAttention | C++ | CUDA | Compiler optimization | FlashInferSenior-level Full TimeUS, CA, Santa Clara R3d ago
-
Senior Software Engineer, CUDA Deep Learning Systems USD 184K-356KC++ | CUDA | Computer Architecture | Deep Learning Compilers | Deep learningBenefits | EquitySenior-level Full TimeUS, CA, Santa Clara R3d ago
-
Software Engineer, CUDA Deep Learning Systems USD 124K-195KC++ | CUDA | Code generation | Computer Architecture | Deep Learning CompilersEquity | Health benefitsMid-level Full TimeUS, CA, Santa Clara R3d ago
-
Senior Deep Learning Algorithm Engineer USD 152K-241KAutoscaling | C++ | Deep learning | Distributed Systems | Inference OptimizationSenior-level Full TimeUS, CA, Santa Clara R3d ago
-
Senior Storage Production Engineer - DGX Cloud USD 184K-333KAccess Control | Anomaly Detection | Ansible | Auditing | BashSenior-level Full TimeUS, CA, Santa Clara R3d ago
-
Senior AI Systems and Algorithms Engineer USD 152K-241KDeep learning | Distributed Systems | Distributed Training | FSDP | GPU PerformanceSenior-level Full TimeUS, CA, Santa Clara R3d ago
-
C++ | CPU architecture | CUDA | Deep learning | Fraud DetectionSenior-level Full TimeUS, CA, Santa Clara R3d ago
-
Automation | C++ | CUDA | Computer Architecture | ContainersSenior-level Full TimeUS, CA, Santa Clara R4d ago
-
Senior Storage Software Engineer - DGX Cloud USD 224K-356KBenchmarks | Block layer | C# | C++ | CSI driversBenefits | EquitySenior-level Full TimeUS, CA, Santa Clara R4d ago
-
Bash | Bootstrap | CSI | CSS3 | Container StorageSenior-level Full TimeUS, CA, Santa Clara R4d ago
-
Senior Agentic AI For Data Science Applied Researcher USD 152K-287KAblation Studies | Agentic AI | Benchmarking | Coding Agents | Data CurationComprehensive benefits package | EquitySenior-level Full TimeUS, CA, Santa Clara R5d ago
-
Senior Machine Learning Engineer USD 184K-287KAWS | Distributed Systems | Kubernetes | Machine Learning | Optimization AlgorithmsEmployee benefits | EquitySenior-level Full TimeUS, CA, Santa Clara R5d ago
-
Senior Software Engineer, CUDA Deep Learning Systems USD 184K-356KC++ | CUDA | CUDA kernels | Computer Architecture | Deep learningBenefits | EquitySenior-level Full TimeUS, CA, Santa Clara R5d ago
-
Senior Deep Learning Frameworks CUDA Software Engineer USD 184K-356KC++ | CUDA | Distributed machine learning | HPC | JAXSenior-level Full TimeUS, CA, Santa Clara R5d ago
-
Senior AI Solutions Architect USD 152K-241KC++ | CUDA | Containers | Data Pipelines | Deep learningSenior-level Full TimeUS, CA, Santa Clara R5d ago
-
Senior Deep Learning Framework Communications Engineer USD 184K-287KC++ | CUDA | CuTe | Elasticity | Fault ToleranceBenefits | EquitySenior-level Full TimeUS, CA, Santa Clara R5d ago
-
Senior Cloud Software Engineer, DGXC Data Services USD 152K-241KAPI Design | Algorithms | Amazon Web Services | C++ | CheckpointsEquity | Health benefitsSenior-level Full TimeUS, CA, Santa Clara R6d ago
-
C# | C++ | CUDA | Communication Scaling | LinuxEquity | Health insurance | Paid time off | Retirement planSenior-level Full TimeUS, CA, Santa Clara R6d ago
-
Senior Software Engineer, AI Storage USD 184K-287KAlgorithms | Bash | C# | C++ | CUDABenefits | EquitySenior-level Full TimeUS, CA, Santa Clara R6d ago
-
Senior Deep Learning Infrastructure Engineer USD 184K-287KAPI Development | Cloud Computing | Data Pipelines | Database technologies | DevOpsEquity | Health benefits | Professional growth | Remote-friendlySenior-level Full TimeUS, CA, Santa Clara R8d ago
-
Senior Solutions Architect, Generative AI USD 184K-287KCollective communication | Congestion Control | Containers | DCGM | Data PipelinesConferencing Tools Access | Occasional travel | Remote workSenior-level Full TimeUS, CA, Santa Clara R9d ago
-
Senior Platform AI Engineer USD 184K-287KAuthentication | Authorization | Backend Infrastructure | C# | C++Senior-level Full TimeUS, CA, Santa Clara R11d ago