Staff Software Engineer, GPU Performance
Sunnyvale, CA, USA; Kirkland, WA, USA
USD 207K-300K Senior-level Full Time
Tasks
- Analyze performance and efficiency metrics
- Drive XLA to GPU and Triton performance toward XLA releases
- Identify and maintain LLM training and serving benchmarks
- Identify bottlenecks and design solutions
- Perform roofline analysis for GPU designs
- Run GPU performance benchmarks using TRT LLM vLLM SGLang
- Run architecture level GPU simulations
- Solve ML model performance problems with cross functional teams
Perks/Benefits
- N/A
Skills/Tech-stack
AMD | CUDA | Code generation | Compiler optimization | Cutlass | GPU Architecture | GPU Performance | LLM | MLIR | Memory hierarchy | NVIDIA | OpenXLA | Performance bottlenecks | Roofline analysis | Runtime Systems | Triton | XLA
Education
Regions
Countries
States
Related jobs
-
BigQuery | Cloud platform | Computer Vision | Data Processing | Data WarehousingSenior-level Full TimeKirkland, WA, USA2h ago
-
Senior Quality Engineer, Applied AI USD 191K-253KAPI | Agentic Systems | Automated testing | CI/CD | Cause analysisSenior-level Full TimeCosta Mesa, California, United States17h ago
-
Sr. Staff AI/ML Engineer USD 245K-288KAPI Design | Agent Orchestration | CI/CD | Content selection | Deep learningSenior-level Full TimeDenver, CO;San Francisco, CA;New York, NY19h ago
-
Machine Learning Engineer - ETA Team USD 137K-299KAirflow | Apache Spark | Deep learning | Experimentation | LLM401k match | Basic life insurance | Commuter benefits match | Dental insurance | Disability insuranceEntry-level Full TimeSunnyvale, CA; San Francisco, CA; Seattle, …23h ago
-
Software Engineer II, Computational Platform USD 124K-154KAWS | Agentic AI | Data Modeling | Docker | ETL401k plan | Annual performance bonus | Commuter support | Company-provided laptop | Flexible paid time offMid-level Full TimeRemote; Watertown, Massachusetts, United States R23h ago
-
Senior AI Engineer | Sage Home Loans USD 150K-220KAgent Orchestration | Automated Regression | Automated regression testing | Cost Optimization | DPO401k match | Disability insurance | Employee assistance program | Flexible paid time off | Flexible spending accountsSenior-level Full TimeCharlotte, NC R23h ago
-
Senior Analytics Engineer USD 108K-160KApache Spark | AtScale | Cloud Data | Cloud Data Warehouse | Cube Semantic LayerSenior-level Full TimeRemote, United States R1d ago
-
AWS | Amazon S3 | Audio Machine Learning | Data Pipelines | Deep learningSenior-level Full TimeWashington D.C., District of Columbia, United …1d ago
-
Senior-level Full TimeSan Antonio, Texas, United States1d ago
-
Senior-level Full TimeBoston, Massachusetts, United States1d ago
-
AWS | Amazon S3 | Audio Processing | Baseten | Data PipelinesBonus | EquitySenior-level Full TimeJacksonville, Florida, United States1d ago
-
AWS | Audio Machine Learning | Baseten | Data Pipelines | FastAPIBonus | EquitySenior-level Full TimeNorth Carolina, Texas, USA1d ago
-
AWS | Baseten | Data Pipelines | FastAPI | Feature EngineeringBonus | EquitySenior-level Full TimeNew York, New York, United States1d ago
-
Senior-level Full TimeMountain View, CA, USA1d ago
-
AWS | Audio signal processing | Baseten | Data Pipelines | FastAPIBonus | EquitySenior-level Full TimeSan Francisco, California, United States1d ago
-
AWS | Amazon S3 | Audio Processing | Baseten | Data PipelinesBonus | EquitySenior-level Full TimeTampa, Florida, United States1d ago
-
Senior-level Full TimeConnecticut, Connecticut, United States1d ago
-
Senior-level Full TimeDallas, Texas, United States1d ago
-
AWS | Audio Machine Learning | Baseten | Data Pipelines | FastAPIBonus | EquitySenior-level Full TimeTexas, Texas, United States1d ago
-
Senior-level Full TimeSanta Clara, California, United States1d ago
-
Senior Software Engineer, GenAI Frontend USD 174K-246KAngular | Application development | Client side | Client-side AI | Graphical User InterfaceBonus | Equity | Health benefitsSenior-level Full TimeMountain View, California1d ago
-
Agentic AI Engineer USD 146K-235KAWS | Agent Orchestration | Agile Scrum | Airflow | ArizeCompassionate care leave | Health benefits | Learning and development | Paid parental leave | Paid time offSenior-level Full TimeSan Francisco, CA, United States1d ago
-
Agent systems | Anomaly Detection | Calibration | Classification | ClusteringDisability benefits | Equity awards | Health insurance | Life insurance | Paid time offSenior-level Full TimeBoston, Massachusetts1d ago
-
Senior Analytics Engineer USD 189K-316KAI | API Integration | C Sharp | Data Quality | Data WarehouseSenior-level Full TimeDurham Blackwell Street, United States1d ago
-
Senior-level Full TimeAZ - Chandler, United States1d ago