Senior Inference Engineer, GPU Kernel Optimization
Tasks
- Analyze end to end LLM inference performance
- Build GPU kernel microbenchmarking infrastructure
- Collaborate with compiler hardware kernel and framework teams
- Design agentic kernel optimization workflows
- Develop optimization policies for production inference
- Diagnose GPU performance gaps with AI driven analysis
- Profile GPU execution and attribute bottlenecks
- Validate optimization findings with silicon measurements
Perks/Benefits
Skills/Tech-stack
C++ | CUDA | CUPTI | Cutlass | GPU Performance | GPU Performance Optimization | GPU Profiling | LLM Inference | LLVM | MLIR | NCU | Nsys | PTX | PTXAS | Performance optimization | Python | SASS | TensorRT | Triton
Education
Regions
Countries
States
Related jobs
-
Senior Data Infrastructure Engineer USD 174K-295KAccess Control | Cloud Storage | Data Lake | Data Modeling | Data ProcessingSenior-level Full TimeSanta Clara, CA15h ago
-
AWS | Azure | C++ | CI/CD | CNNSenior-level Full TimeSanta Clara, CA1d ago
-
Senior SOCD Applied AI Engineer USD 168K-264KAPI Design | CI/CD | Claude Code | Containers | DatabasesSenior-level Full TimeUS, CA, Santa Clara4d ago
-
Distinguished AI Engineer (Office of the CTO) USD 157K-254KAmazon SageMaker | Attack Vectors | Azure Machine Learning | CI/CD | Containerized inferenceSenior-level Full TimeSanta Clara, CA4d ago
-
Machine Learning Engineer, AI Safety USD 124K-195KBias Mitigation | Bias detection | Data Monitoring | Deep learning | KerasMid-level Full TimeUS, CA, Santa Clara R4d ago
-
Senior Software Engineer - GPU Local AI Platforms USD 224K-356KAttention Mechanism | C++ | CI/CD | CUDA | Continuous batchingSenior-level Full TimeUS, CA, Santa Clara4d ago
-
Senior AI Workflow Engineer USD 184K-287K.NET | AWS | Agentic AI | Angular | AnsibleEquity | Health insurance | Paid time off | Retirement plansSenior-level Full TimeUS, CA, Santa Clara4d ago
-
Senior Software Engineer, Deep Learning - MLIR TRT USD 184K-287KC# | C++ | CUDA | Computer Vision | Deep learningSenior-level Full TimeUS, CA, Santa Clara4d ago
-
C# | C++ | DRAM | Distributed Systems | GPUSenior-level Full TimeUS, CA, Santa Clara R4d ago
-
AI infrastructure | C++ | CUDA | Data Preprocessing | Data loadingBenefits | EquitySenior-level Full TimeUS, CA, Santa Clara4d ago
-
Senior Deep Learning Frameworks Sustaining Engineer USD 152K-218KBazel | C# | C++ | CI/CD | CUDAEquity | Health insurance | Paid time offSenior-level Full TimeUS, CA, Santa Clara4d ago
-
Senior Machine Learning Data Curation Engineer USD 174K-295KAWS | Big Data | BigQuery | Data Annotation | Data GovernanceComputational resources | Dinners | Fun activities | Lunches | SnacksSenior-level Full TimeSanta Clara, CA5d ago
-
BIOS | BMC | Bash | C# | C++Senior-level Full TimeUS, CA, Santa Clara5d ago
-
AWS | Amazon EFA | Azure | Bash | BeeGFSComprehensive benefits package | EquitySenior-level Full TimeUS, CA, Santa Clara5d ago
-
Artificial Intelligence | C# | C++ | CUDA | Computer ArchitectureSenior-level Full TimeUS, CA, Santa Clara5d ago
-
Distinguished Engineer, Storage – AI Cloud USD 320K-488KAPI Design | Availability | BeeGFS | Block Storage | By DesignSenior-level Full TimeUS, CA, Santa Clara5d ago
-
Principal Deep Learning Algorithm Engineer USD 272K-431KC++ | CUDA | Computer Architecture | Deep learning | GPU ProgrammingBenefits | EquitySenior-level Full TimeUS, CA, Santa Clara R6d ago
-
Supply Chain Data Engineer USD 152K-230KAWS | Apache Airflow | Azure | BigQuery | DBTBenefits | EquitySenior-level Full TimeUS, CA, Santa Clara6d ago
-
ADA | ARM | ARMv8 | BSP | Bring-upBenefits | EquitySenior-level Full TimeUS, CA, Santa Clara6d ago
-
Senior Cloud Software Engineer, DGXC Data Services USD 152K-241KAPI Design | AWS | Algorithms | C++ | Data StructuresBenefits | EquitySenior-level Full TimeUS, CA, Santa Clara R6d ago
-
AI readiness | AWS | Access Management | Architecture | AsanaCareer growth opportunities | Customer facing exposure | Remote workSenior-level Full TimeHonduras - Tegucigalpa7d ago
-
C++ | CUDA | Containerization | Distributed Systems | DockerSenior-level Full TimeUS, CA, Santa Clara R7d ago
-
Principal Machine Learning Engineer USD 157K-254KAWS | Apache Flink | Azure | CI/CD | CloudFormationFlexible work schedule | In-office work flexibilitySenior-level Full TimeSanta Clara, CA7d ago
-
C++ | Computer Vision | Curriculum learning | Data pipeline | Deep learningSenior-level Full TimeUS, CA, Santa Clara R8d ago
-
Senior Deep Learning Framework Communications Engineer USD 152K-241KC++ | CUDA | Communication overlap | Compiler optimization | Compute Communication OverlapSenior-level Full TimeUS, CA, Santa Clara R8d ago