Senior Inference Engineer, GPU Kernel Optimization
Tasks
- Analyze end to end model performance
- Build GPU kernel microbenchmarking infrastructure
- Collaborate with compiler hardware kernel and framework teams
- Develop optimization policies for production inference
- Diagnose performance gaps in GPU kernels
- Implement agentic kernel optimization workflows
- Profile GPU performance and attribute bottlenecks
- Validate optimization findings with silicon measurements
Perks/Benefits
- N/A
Skills/Tech-stack
C++ | CUDA | CUPTI | Cutlass | LLVM | MLIR | NVIDIA Nsight | NVIDIA Nsight Compute | Nsight Compute | Nsight Systems | PTX | PTXAS | Python | SASS | SGLang | TRT-LLM | Triton | VLLM
Education
Regions
Countries
States
Related jobs
-
GenAI Software Development Engineer USD 152K-243KAPI Design | AWS | Agent Orchestration | Angular | Async ProgrammingSenior-level Full TimeUS,CA,Santa Clara1d ago
-
Mid-level Full TimeSydney, Australia; Newcastle, Australia2d ago
-
Senior AI Engineer, High Performance AI USD 152K-241KAgent systems | C# | C++ | CUDA | Compiler optimizationSenior-level Full TimeUS, CA, Santa Clara R2d ago
-
Senior Compute System Software Engineer USD 184K-287KC# | C++ | Clock management | Device Drivers | Kernel DriversEquity | Health benefitsSenior-level Full TimeUS, CA, Santa Clara2d ago
-
Applied AI Innovation Engineer — Sales AI Applications USD 124K-195KAI Governance | APIs | Agentic Workflows | Artificial Intelligence | BenchmarkingEmployee benefits | EquityMid-level Full TimeUS, CA, Santa Clara3d ago
-
Checkpointing | Data Pipelines | Data Processing | Data loading | Data parallelismSenior-level Full TimeUS, CA, Santa Clara R3d ago
-
Machine Learning Engineer, AI Safety USD 152K-270KAlignment | Automation | Bias detection | Content Safety | Dataset developmentMid-level Full TimeUS, CA, Santa Clara R3d ago
-
Lead AI Data Engineer – Platform & Analytics BRL 40K-40KAWS Athena | Apache Airflow | Apache Iceberg | DAGs | DBT CoreSenior-level Full TimeUS,CA,Santa Clara4d ago
-
Senior Software Engineer - AI Inference Performance USD 184K-287KBatching | C++ | CUDA | CUDA Graphs | CUDA kernelsSenior-level Full TimeUS, CA, Santa Clara4d ago
-
C# | C++ | Cloud Computing | Data Management | Distributed SystemsSenior-level Full TimeUS, CA, Santa Clara4d ago
-
AWS | Azure | C++ | Capacity Planning | Data ModelingSenior-level Full TimeUS, CA, Santa Clara4d ago
-
Senior-level Full TimeUS, CA, Santa Clara R5d ago
-
Automation | CI/CD | Command Line | Command-line Interface | Continuous integrationEquity | Hybrid workSenior-level Full TimeUS, CA, Santa Clara5d ago
-
Senior Applied AI Engineer, Product Simulation USD 184K-287KAI | Agent Design | CI/CD | Firmware | Human-in-the-loopSenior-level Full TimeUS, CA, Santa Clara5d ago
-
Lead ASIC Package Design Automation and AI Engineer USD 160K-264K2.5D IC | 3D-IC | Artificial Intelligence | Auto-routing | C++Senior-level Full TimeUS,CA,Santa Clara6d ago
-
Staff/Sr. Staff AI Engineer - IT Business Applications USD 145K-235KAWS | Agile | Azure | CI/CD | Distributed SystemsSenior-level Full TimeSanta Clara, CA6d ago
-
AWS | Adversarial Training | Agent systems | Autonomous Agents | AzureSenior-level Full TimeSanta Clara, CA6d ago
-
Senior Deep Learning Software Engineer, DLSim USD 152K-241KArchitectural simulation | C# | C++ | Compiler infrastructure | Compiler optimizationEquity | Health benefits | Paid time offSenior-level Full TimeUS, CA, Santa Clara6d ago
-
Architecture Search | CUDA | CUDA Compilation | CUDA kernel | GPU ProfilingSenior-level Full TimeUS, CA, Santa Clara R6d ago
-
Senior Software Engineer - Cloud Data Platform USD 140K-160KAWS | Alerting | Azure | CI/CD | Cause analysis401k | Dental insurance | Employee referral program | Health savings account | Life insuranceSenior-level Full TimeSanta Clara, CA8d ago
-
Software Engineer (Applied AI/ML) USD 200K-250KCI/CD | Data Pipelines | Data ontologies | Design of Experiments | Digital Twins401k | Bonuses | Equity | FSA | Flexible time offMid-level Full TimeSanta Clara, CA or Remote R8d ago
-
Principal Software Engineer (Data Platform Prisma AIRS) USD 147K-237KAirflow | Apache Beam | Apache Spark | Batch Processing | BenchmarkingSenior-level Full TimeSanta Clara, CA9d ago
-
Senior Solutions Architect, Inference Service Providers USD 184K-287KAgent Design | Cache Management | Custom Inference Kernels | Data Curation | DevOpsSenior-level Full TimeUS, CA, Santa Clara R9d ago
-
Array computing | Asynchronous programming | C++ | CUDA | Compiler optimizationBenefits | EquitySenior-level Full TimeUS, CA, Santa Clara R9d ago
-
Senior Software Engineer, RL Post-Training Frameworks USD 184K-287KActor Based Programming | C# | C++ | Deep learning | Distributed SystemsSenior-level Full TimeUS, CA, Santa Clara R9d ago