Staff Software Engineer - GenAI Performance and Kernel
Tasks
- Benchmark kernels
- Build profiling and instrumentation tools
- Collaborate on production rollout and monitoring
- Design core compute kernels
- Detect performance regressions
- Establish kernel abstractions and frameworks
- Implement compute kernels
- Integrate kernel optimizations into ML systems
- Maintain kernel software
- Mentor engineers
- Optimize kernel performance
- Perform root cause analysis on inference bottlenecks
- Review code and set best practices
- Verify kernel correctness
Perks/Benefits
- N/A
Skills/Tech-stack
Assembly | Auto-tuning | CUBLAS | CUDA | CUDNN | Cutlass | Debugging | Error propagation | Fusion | GPU Architecture | GPU memory | GPU memory hierarchy | LLVM IR | Loop transformations | Memory Reuse | Memory hierarchy | Mixed Precision | Numerical Stability | OneDNN | OpenCL | Profiling | Quantization | Software pipelining | Sparsity | Tensor cores | Tensorization | Tiling | Triton | Vectorization | Warp scheduling
Education
Roles
Regions
Countries
States
Related jobs
-
Senior Research Engineer / Scientist - Storage for LLM USD 207K-368KAutoregressive decoding | Batched decoding | C++ | CUDA | CUDA aware Networking401k savings plan with company match | Conference attendance | Life insurance | Long-term disability | Medical/Dental/Vision insuranceSenior-level Full TimeSeattle, Washington, United States R3h ago
-
C# | C++ | Convolutional Neural Networks | Data Movement | Deep learning401k savings plan with company match | Life insurance | Long-Term Disability coverage | Medical/Dental/Vision insurance | Paid HolidaysMid-level Full TimeSan Jose, California, United States3h ago
-
C# | C++ | CPU architecture | Cache optimization | Code generation401k match | Dental insurance | Life insurance | Medical insurance | Paid HolidaysEntry-level Full TimeSan Jose, California, United States3h ago
-
Algorithms | Autoscaling | C++ | Concurrent programming | Containerization401k match | Life insurance | Long-Term Disability coverage | Medical/Dental/Vision insurance | Paid HolidaysEntry-level Full TimeSan Jose, California, United States3h ago
-
Access Optimization | C# | C++ | CUDA | Computational Graph Optimization401k match | Dental insurance | Life insurance | Long-term disability | Medical insuranceEntry-level Full TimeSan Jose, California, United States3h ago
-
Large Language Model Inference System Engineer Graduate (Applied Machine Learning) - 2027 Start USD 128K-256KC++ | CUDA | Distributed Systems | GPU | High Performance401k match | Dental insurance | Life insurance | Long-term disability | Medical insuranceEntry-level Full TimeSan Jose, California, United States3h ago
-
C++ | CUDA | Deep learning | Distributed Training | GPU AccelerationEntry-level Full TimeSan Jose, California, United States3h ago
-
C# | C++ | CPU architecture | CUDA | Containerization401k matching | Dental insurance | Life insurance | Long-term disability | Medical insuranceMid-level Full TimeSeattle, Washington, United States3h ago
-
Automation | Benchmarking | C++ | Compiler optimization | Data parallelismHealth insurance | Housing allowance | Life insurance | Paid Holidays | Paid sick timeEntry-level Full TimeSan Jose, California, United States3h ago
-
Research Engineer / Scientist - Storage for LLM USD 153K-300KBatching | C++ | CUDA | CUDA Networking | CUDA aware Networking401k matching | Life insurance | Long-term disability | Medical, dental, and vision insurance | Paid HolidaysMid-level Full TimeSeattle, Washington, United States R3h ago
-
A/B | A/B Testing | B testing | Continual Learning | DistillationSenior-level Full TimeSeattle, Washington, United States3h ago
-
C plus plus | C# | CPU GPU | CPU/GPU profiling | CUDAMid-level Full TimeSan Jose, California, United States3h ago
-
C++ | CUDA | Checkpointing | Data parallelism | Distributed Training401k match | Dental insurance | Health insurance | Life insurance | Long-term disabilitySenior-level Full TimeSeattle, Washington, United States4h ago
-
C++ | Congestion Control | GPU Architecture | Go | MPIHealth insurance | Housing allowance | Life insurance | Paid Holidays | Paid sick timeEntry-level InternshipSan Jose, California, United States4h ago
-
Algorithms | Android | Audio pipelines | Bare Metal | C++Senior-level Full TimeSan Jose, CA, USA; Kirkland, WA, …4h ago
-
Artificial Intelligence | Data Processing | Debugging | Distributed Systems | Fine TuningSenior-level Full TimeMountain View, CA, USA4h ago
-
Artificial Intelligence | Cloud platform | Code review | Data Structures | Data Structures and AlgorithmsSenior-level Full TimeSunnyvale, CA, USA; Kirkland, WA, USA4h ago
-
Senior Software Engineer, AI/ML, Android USD 174K-252KC++ | Data Processing | Data Structures | Data Structures and Algorithms | DebuggingSenior-level Full TimeMountain View, CA, USA4h ago
-
Senior Software Engineer, Embedded, Pixel Graphics USD 174K-252KC# | C++ | Device Drivers | Embedded Linux | GPGPUSenior-level Full TimeMountain View, CA, USA; San Diego, …4h ago
-
Senior Software Engineer, AI/ML GenAI, Google Cloud USD 174K-252KC++ | Computer Vision | Data Processing | Debugging | GenAISenior-level Full TimeSunnyvale, CA, USA; New York, NY, …4h ago
-
Software Engineer III, AI/ML, Google Cloud Platforms USD 147K-210KC++ | Data Processing | Debugging | Language Processing | ML InfrastructureSenior-level Full TimeSunnyvale, CA, USA4h ago
-
AI/Machine Learning Engineer - Python - Loops USD 130K-150KAPI Development | CI/CD | Data Pipelines | Debugging | Embeddings401k | Community volunteering events | Dental insurance | Disability benefits | Flexible paid time offEntry-level Full TimePalo Alto, California, United States18h ago
-
Lab Automation - Robotics Engineer USD 150K-180KAPI Integration | Accelerated inference | Automation | Behavior Trees | C#Entry-level Full TimeSouth San Francisco, California, United States18h ago
-
Senior-level Full TimeUnited States, California, Mountain View; United …18h ago
-
Software Engineer II USD 120K-145KAPIs | Alerting | Amazon Web Services | Apache Spark | Automated testing401k match | ADandD insurance | Accident insurance | Company holidays | Critical illness insuranceMid-level Full TimeKirkland, WA20h ago