Senior Deep Learning Software Engineer, Inference and Model Optimization
US, CA, Santa Clara
R
USD 184K-287K (estimate) Senior-level Full Time
Tasks
- Analyze and extract standardized model graph representation
- Architect modular scalable software platform
- Build automated inference and deployment solution
- Collaborate on performant kernel implementations
- Develop GPU inference optimization techniques
- Develop and deploy generative AI models
- Implement efficient attention kernels with kv caching
- Optimize model sharding techniques
- Profile GPU kernel performance
Perks/Benefits
- N/A
Skills/Tech-stack
Architecture Search | CUDA | CUDA Compilation | CUDA kernel | GPU Profiling | Huggingface | JAX | KV cache | Model sharding | Neural Architecture | Neural Architecture Search | Pruning | PyTorch | Python | Quantization | Sequence parallelism | Sparsity | Tensor Parallelism | TensorRT | TorchCompile | TorchDynamo | Torchexport | Triton
Education
Regions
Countries
States
Related jobs
-
Senior-level Full TimeUS, CA, Santa Clara R2d ago
-
Software Engineer (Applied AI/ML) USD 200K-250KCI/CD | Data Pipelines | Data ontologies | Design of Experiments | Digital Twins401k | Bonuses | Equity | FSA | Flexible time offMid-level Full TimeSanta Clara, CA or Remote R5d ago
-
Senior Solutions Architect, Inference Service Providers USD 184K-287KAgent Design | Cache Management | Custom Inference Kernels | Data Curation | DevOpsSenior-level Full TimeUS, CA, Santa Clara R6d ago
-
Array computing | Asynchronous programming | C++ | CUDA | Compiler optimizationBenefits | EquitySenior-level Full TimeUS, CA, Santa Clara R6d ago
-
Senior Software Engineer, RL Post-Training Frameworks USD 184K-287KActor Based Programming | C# | C++ | Deep learning | Distributed SystemsSenior-level Full TimeUS, CA, Santa Clara R6d ago
-
AWS | Azure | C# | C++ | Computer VisionEntry-level InternshipUS,CA,Santa Clara R6d ago
-
AWS | Azure | C# | C++ | Computer VisionHybrid or onsite workEntry-level InternshipUS,CA,Santa Clara R6d ago
-
Senior-level Full TimeUS, CA, Santa Clara R7d ago
-
Senior AI Infrastructure Software Engineer - DGX Cloud USD 184K-287KC# | C++ | Cause analysis | Debugging | Distributed SystemsBenefits | EquitySenior-level Full TimeUS, CA, Santa Clara R7d ago
-
Senior-level Full TimeUS, CA, Santa Clara R8d ago
-
BEV | C++ | Computer Vision | Data Augmentation | Data SimulationBenefits | EquitySenior-level Full TimeUS, CA, Santa Clara R9d ago
-
Senior Deep Learning Algorithm Engineer USD 184K-287KCPU architecture | Distributed Computing | GPU Architecture | Generative AI | JAXEquity | Health benefitsSenior-level Full TimeUS, CA, Santa Clara R13d ago
-
Senior Deep Learning Compiler Engineer - XLA USD 152K-241KC# | C++ | CUDA | Code generation | DebuggingSenior-level Full TimeUS, CA, Santa Clara R13d ago
-
C++ | CUDA | CuDF | DataFrame | Database accelerationSenior-level Full TimeUS, CA, Santa Clara R13d ago
-
C++ | CUDA | Docker | Infiniband | JAXSenior-level Full TimeUS, CA, Santa Clara R13d ago
-
Distinguished Engineer, Scaled Out Inferencing USD 320K-488KAI infrastructure | CUDA | Cloud Native | Cloud Native Architecture | Container OrchestrationSenior-level Full TimeUS, CA, Santa Clara R16d ago
-
Software Engineer, CUDA Deep Learning Systems USD 152K-258KC++ | CUDA | Computer Architecture | Deep learning | Distributed ComputingBenefits | EquityMid-level Full TimeUS, CA, Santa Clara R16d ago
-
C# | C++ | Caching | Distributed Systems | GPU ArchitectureComprehensive benefits | EquitySenior-level Full TimeUS, CA, Santa Clara R22d ago
-
Senior Software Engineer, CUDA Deep Learning Systems USD 184K-356KC++ | CUDA | Computer Architecture | Deep Learning Compilers | Deep learningBenefits | EquitySenior-level Full TimeUS, CA, Santa Clara R22d ago
-
Senior Deep Learning Algorithm Engineer USD 152K-241KAutoscaling | C++ | Deep learning | Distributed Systems | Inference OptimizationSenior-level Full TimeUS, CA, Santa Clara R22d ago
-
Senior Storage Production Engineer - DGX Cloud USD 184K-333KAccess Control | Anomaly Detection | Ansible | Auditing | BashSenior-level Full TimeUS, CA, Santa Clara R22d ago
-
C++ | CPU architecture | CUDA | Deep learning | Fraud DetectionSenior-level Full TimeUS, CA, Santa Clara R22d ago
-
Bash | Bootstrap | CSI | CSS3 | Container StorageSenior-level Full TimeUS, CA, Santa Clara R23d ago
-
Senior Software Engineer, CUDA Deep Learning Systems USD 184K-356KC++ | CUDA | CUDA kernels | Computer Architecture | Deep learningBenefits | EquitySenior-level Full TimeUS, CA, Santa Clara R24d ago
-
Senior Deep Learning Frameworks CUDA Software Engineer USD 184K-356KC++ | CUDA | Distributed machine learning | HPC | JAXSenior-level Full TimeUS, CA, Santa Clara R24d ago