Senior Software Engineer - GPU Local AI Platforms
Tasks
- Analyze model architectures and inference algorithms on GPU
- Characterize multi node inference communication and parallelism
- Develop and maintain inference recipes
- Own model validation workflow
- Produce performance analysis reports
- Serve as technical point of contact for hardware specific inference issues
- Track and evaluate open source LLM inference innovations
Perks/Benefits
- N/A
Skills/Tech-stack
Attention Mechanism | C++ | CI/CD | CUDA | Continuous batching | Docker | KV cache | Mixture of Experts | Model Validation | Multi Token Prediction | NCCL | Nvidia Container Toolkit | OCI | Performance optimization | Python | Quantization | RCCL | Speculative decoding | Tensor Parallelism | Triton
Education
Regions
Countries
States
Related jobs
-
Senior SOCD Applied AI Engineer USD 168K-264KAPI Design | CI/CD | Claude Code | Containers | DatabasesSenior-level Full TimeUS, CA, Santa Clara2d ago
-
Distinguished AI Engineer (Office of the CTO) USD 157K-254KAmazon SageMaker | Attack Vectors | Azure Machine Learning | CI/CD | Containerized inferenceSenior-level Full TimeSanta Clara, CA2d ago
-
Machine Learning Engineer, AI Safety USD 124K-195KBias Mitigation | Bias detection | Data Monitoring | Deep learning | KerasMid-level Full TimeUS, CA, Santa Clara R2d ago
-
Senior AI Workflow Engineer USD 184K-287K.NET | AWS | Agentic AI | Angular | AnsibleEquity | Health insurance | Paid time off | Retirement plansSenior-level Full TimeUS, CA, Santa Clara2d ago
-
Senior Software Engineer, Deep Learning - MLIR TRT USD 184K-287KC# | C++ | CUDA | Computer Vision | Deep learningSenior-level Full TimeUS, CA, Santa Clara2d ago
-
C# | C++ | DRAM | Distributed Systems | GPUSenior-level Full TimeUS, CA, Santa Clara R2d ago
-
AI infrastructure | C++ | CUDA | Data Preprocessing | Data loadingBenefits | EquitySenior-level Full TimeUS, CA, Santa Clara2d ago
-
Senior Deep Learning Frameworks Sustaining Engineer USD 152K-218KBazel | C# | C++ | CI/CD | CUDAEquity | Health insurance | Paid time offSenior-level Full TimeUS, CA, Santa Clara2d ago
-
Senior Machine Learning Data Curation Engineer USD 174K-295KAWS | Big Data | BigQuery | Data Annotation | Data GovernanceComputational resources | Dinners | Fun activities | Lunches | SnacksSenior-level Full TimeSanta Clara, CA3d ago
-
BIOS | BMC | Bash | C# | C++Senior-level Full TimeUS, CA, Santa Clara3d ago
-
AWS | Amazon EFA | Azure | Bash | BeeGFSComprehensive benefits package | EquitySenior-level Full TimeUS, CA, Santa Clara3d ago
-
Artificial Intelligence | C# | C++ | CUDA | Computer ArchitectureSenior-level Full TimeUS, CA, Santa Clara3d ago
-
Distinguished Engineer, Storage – AI Cloud USD 320K-488KAPI Design | Availability | BeeGFS | Block Storage | By DesignSenior-level Full TimeUS, CA, Santa Clara3d ago
-
Principal Deep Learning Algorithm Engineer USD 272K-431KC++ | CUDA | Computer Architecture | Deep learning | GPU ProgrammingBenefits | EquitySenior-level Full TimeUS, CA, Santa Clara R4d ago
-
Supply Chain Data Engineer USD 152K-230KAWS | Apache Airflow | Azure | BigQuery | DBTBenefits | EquitySenior-level Full TimeUS, CA, Santa Clara4d ago
-
ADA | ARM | ARMv8 | BSP | Bring-upBenefits | EquitySenior-level Full TimeUS, CA, Santa Clara4d ago
-
Senior Cloud Software Engineer, DGXC Data Services USD 152K-241KAPI Design | AWS | Algorithms | C++ | Data StructuresBenefits | EquitySenior-level Full TimeUS, CA, Santa Clara R4d ago
-
AI readiness | AWS | Access Management | Architecture | AsanaCareer growth opportunities | Customer facing exposure | Remote workSenior-level Full TimeHonduras - Tegucigalpa4d ago
-
C++ | CUDA | Containerization | Distributed Systems | DockerSenior-level Full TimeUS, CA, Santa Clara R5d ago
-
Principal Machine Learning Engineer USD 157K-254KAWS | Apache Flink | Azure | CI/CD | CloudFormationFlexible work schedule | In-office work flexibilitySenior-level Full TimeSanta Clara, CA5d ago
-
C++ | Computer Vision | Curriculum learning | Data pipeline | Deep learningSenior-level Full TimeUS, CA, Santa Clara R6d ago
-
Senior Deep Learning Framework Communications Engineer USD 152K-241KC++ | CUDA | Communication overlap | Compiler optimization | Compute Communication OverlapSenior-level Full TimeUS, CA, Santa Clara R6d ago
-
Performance Engineer, Deep Learning and HPC USD 116K-189KAWS | Amber | Azure | Compilers | Data AnalysisSenior-level Full TimeUS, CA, Santa Clara6d ago
-
C++ | CUDA | Distributed inference | GPU Architecture | Graph CompilerBenefits | EquitySenior-level Full TimeUS, CA, Santa Clara R6d ago
-
3D Computer Vision | 3D representations | Active Learning | Auto-labeling | BEVBenefits | EquitySenior-level Full TimeUS, CA, Santa Clara6d ago