Staff Engineer, Inference Optimizations
Tasks
- Advise on GPU software stacks
- Apply parallelization across multi node GPU clusters
- Collaborate with product and TPMs to ship inference features
- Contribute to open source AI performance projects
- Design benchmarking and performance optimizations
- Develop quantization techniques
- Identify kernel fusion opportunities
- Implement attention layer optimizations
- Improve batch size performance
- Integrate and build open source software
- Lead inference performance architecture
- Lead technical mentorship through code reviews
- Manage memory and precision
- Optimize GPU kernels
- Perform systems design for low level GPU programming
- Tune mixture of experts router kernels
Perks/Benefits
- Conference reimbursement
- Employee assistance program
- Flexible time off
- LinkedIn Learning access
- Local Employee Meetups
- Remote work
- Training reimbursement
Skills/Tech-stack
AMD GPU | Attention Optimization | Bandwidth Optimization | Benchmarking | CUDA | CUDA kernels | FP4 | FP8 | FlashAttention | GPU Kernels | INT8 | Kernel Fusion | MOE | Memory bandwidth | Memory bandwidth optimization | Mixture of Experts | NVIDIA GPU | Parallel Computing | Precision Management | Quantization | ROCm | System design | Tensor cores | TensorRT | Triton
Education
N/A
Related jobs
-
Senior Research Engineer, LLM Training & Post-Training USD 165K-310KCUDA | DPO | DeepSpeed | Distributed Training | Experiment design401k matching | Company holidays | Comprehensive health coverage | Dental coverage | Flexible time offSenior-level Full TimeNew York, New York, United States; … R22h ago
-
Data Engineering Tech Lead USD 10KAPI Development | Apache Spark | Automated unit testing | Azure | Azure DataSenior-level Full TimeWORK AT HOME - OHIO, United … R1d ago
-
Principal Engineer-AI/ML Engineering USD 189K-231KCloud Computing | Data Analysis | Data Mining | Feature Engineering | Machine LearningHybrid work flexibility | Work from homeSenior-level Full TimeOne Verizon Way, Basking Ridge, NJ … R1d ago
-
AI/ML Engineer, Lead USD 128K-292KAWS | Agent Orchestration | Agentic AI | Autonomous Agents | AzureDependent care | Paid leave | Professional development | Tuition assistance | Work-life programsSenior-level Full TimeUSA, VA, Ashburn (22001 Loudoun County … R1d ago
-
Edge AI Engineer USD 100K-155KArchitecture Optimization | Bias Evaluation | C++ | Core ML | DSPRemote workSenior-level Full TimeUnited States - Remote R1d ago
-
Principal Agentic AI Engineer USD 206K-451KAlgorithms | Autogen | Concurrency | Data Structures | Fine TuningHybrid work | In-person work | Remote workSenior-level Full TimeSeattle (WA), United States R1d ago
-
Large Language Model Specialist USD 100K-150KAdapter-Tuning | Benchmarking | DPO | Dataset curation | Distributed TrainingSenior-level Full TimeBellevue, WA R1d ago
-
MLOps Engineer USD 100K-150KAPI Gateway | Abuse detection | Access Management | Automated rollback | AutoscalingSenior-level Full TimeUnited States - Remote R1d ago
-
AI Optimization Engineer USD 100K-100KC++ | Compiler optimization | Cutlass | Deep learning | DeepSpeedRemote workSenior-level Full TimeUnited States - Remote R1d ago
-
ML Performance Engineer USD 100K-150KBenchmarking | C++ | Compiler optimization | Continuous batching | Deep learningRemote workSenior-level Full TimeBellevue, WA R1d ago
-
AWS | AWS Batch | AWS Bedrock | AWS CDK | AWS IoTHealthcare | PTO | Paid Holidays | Phone stipend | Wellness stipendSenior-level Full TimeSan Carlos - Hybrid R2d ago
-
Machine Leaning Performance Engineer (Inference) USD 200K-300KC++ | CUBLAS | CUDA | CUDA C | CutlassFitness Events | Free meals | Hybrid work options | Paid time off | Volunteer opportunitiesMid-level Full TimeNew York R2d ago
-
Edge Computing AI Engineer USD 100K-105KC++ | Edge inference | Embedded Systems | Federated Learning | Machine LearningCareer growthMid-level Full TimeUnited States - Remote R2d ago
-
Edge AI Engineer USD 70K-100KC++ | Edge inference | Embedded Systems | Hardware-Aware Optimization | Machine LearningCareer growth | Remote workSenior-level Full TimeUnited States - Remote R2d ago
-
Algorithm Engineer (Image Processing) USD 105K-180KC plus plus | CUDA | Computer Vision | Data Analysis | Data Visualization401k matching | Dental insurance | Development and career growth | Employee assistance program | Employee stock purchase programSenior-level Full TimeUSA-MI-Ann Arbor-KLA, United States R2d ago
-
Senior AI Engineer USD 120K-160KAWS | Benchmarking | Databricks | FastAPI | Flask401k Safe Harbor Plan | Bounty programs | Certification reimbursement | Free health insurance | Generous PTOSenior-level Full TimeSchenectady, New York, United States, Remote R2d ago
-
Backend Engineer, AI Internal Systems USD 90K-120KAPI Development | AWS | Azure | Cloud infrastructure | Cloud platformEntry-level Full TimeUnited States R3d ago
-
Machine Learning Systems Engineer USD 144K-192KCUDA | GPU Profiling | Kernel Fusion | PyTorch | PyTorch distributed401k match | Dental insurance | Health insurance | Health savings account | Life insuranceSenior-level Full TimeBoston, Massachusetts, United States; Las Vegas, … R3d ago
-
Agile | Build Automation | C++ | Configuration Management | Object-Oriented401k | Flexible work schedule | Health insurance | Paid HolidaysEntry-level Full TimeUnited States of America Mayfield Heights R3d ago
-
Agile | Build and configuration | Build and configuration management | C++ | Configuration Management401k | Flexible work schedule | Health insurance | Paid HolidaysEntry-level Full TimeUnited States of America Mayfield Heights R3d ago
-
Edge ML Engineer USD 100K-150KC++ | Edge AI | Embedded Systems | Federated Learning | Machine LearningSenior-level Full TimeUnited States - Remote R3d ago
-
AI Platform Engineer USD 130K-180KAPI Gateway | AWS | Alerting | Autoscaling | Azure BicepCareer growth | Remote workSenior-level Full TimeUnited States - Remote R3d ago
-
Staff ML Engineer, Perception Research USD 251K-310K3D Perception | Autoregressive models | Data Pipelines | Data parallelism | Diffusion Models401k match | Baby bonding leave | Dental insurance | Disability insurance | Health insuranceSenior-level Full TimeMountain View, CA, USA ; New … R5d ago
-
Software Engineer, Inference Runtime USD 150K-350KC++ | CPU Profiling | CUDA | Executorch | GPU ProfilingDental insurance | Flexible PTO | Flexible WFH | Medical insurance | Team mealsMid-level Full TimeNew York City R5d ago
-
Principal AI Engineer – Agentic AI / Generative AI | Irvine, CA (Hybrid) | Contract to Hire | AS A USD 100K-150KAI Agents | API | AWS | Agent systems | CI/CDContract-to-hire | Hybrid workSenior-level Full TimeIrvine, CA R6d ago