Staff Engineer, Inference Optimizations
Tasks
- Benchmark inference engine performance
- Collaborate with product teams to deliver inference features
- Contribute to open source AI infrastructure
- Develop quantization techniques for inference
- Drive hardware and software integration for GPUs
- Identify kernel fusion opportunities
- Implement advanced parallelization across multi node GPU clusters
- Lead design reviews and technical mentorship
- Lead inference performance architecture
- Optimize GPU kernels for attention layers
- Optimize memory and precision management
- Tune MoE expert gateway router kernels
Perks/Benefits
- Conference reimbursement
- Education reimbursement
- Employee assistance program
- Flexible time off
- LinkedIn Learning access
- Local Employee Meetups
- Training reimbursement
Skills/Tech-stack
AMD GPU | Artificial Intelligence | Attention Mechanisms | Bandwidth Optimization | CUDA | CUDA kernel | Compute Utilization Optimization | Compute utilization | Distributed Systems | FP4 | FP8 | FlashAttention | GPU Programming | High Performance | High-Performance Computing | INT8 | Kernel Fusion | Language Models | Large Language Models | MOE | Memory bandwidth | Memory bandwidth optimization | Mixture of Experts | NVIDIA GPU | OpenAI Triton | OpenAI Triton Compiler | Parallel Computing | Performance Computing | Quantization | RMSNorm | ROCm | TensorRT | Triton | Triton Compiler | Utilization Optimization
Education
N/A
Related jobs
-
Featured Feat. Associate Director, Data Labs USD 167K-167KAWS | Cloud Computing | Compute Infrastructure | Data Analysis | LLM GovernanceConference speaking opportunities | Hybrid work schedule | Media appearancesSenior-level Full TimeWashington, District of Columbia, 20004, United … R27d ago
-
AI orchestration | BOM | Constraint Optimization | Deep research | Digital TwinsDental insurance | Health insurance | Housing subsidy | In-office meals | Relocation supportSenior-level Full TimeSan Jose7h ago
-
Agentic AI Engineer USD 94K-149KCI/CD | Distributed tracing | Docker | Elasticsearch Relevance Engine | IAMFlexible work schedules | Generous vacation days | Health coverage | Parental leave | Volunteer time offSenior-level Full TimeUnited States10h ago
-
Machine Learning Engineer USD 80K-90KDeep learning | Evaluation metrics | Generalization | Language Models | Large Language ModelsSenior-level Full TimeFremont, California R12h ago
-
Embedded Software Engineer, Access Control USD 125K-160KBash | C# | C++ | Device Drivers | Distributed SystemsCommuter benefits | Fertility benefits | Flexible PTO | Flexible spending account | Health Saving AccountMid-level Full TimeSan Mateo, CA United States12h ago
-
Staff AI Data Platform Engineer USD 138K-173KAPI Gateway | AWS | Access Control | Data Lineage | Data QualityEducational reimbursement | Employee insurance plan | Unlimited vacation | Wellness reimbursementSenior-level Full TimeSan Ramon, CA; Reno, NV12h ago
-
Senior Software Engineer - Machine Learning USD 134K-182KApache Flink | Apache Kafka | Big Data | Data Engineering | Deep learning401k match | Dental insurance | Health insurance | Life insurance | Long-term disabilitySenior-level Full TimeFrisco, TX 75034, United States12h ago
-
Senior Software Engineer (Storage) - remote in the US USD 100K-150KArgo CD | ArgoCD | Block Storage | CSI | Cluster APISenior-level Full TimeBoston, MA, United States R13h ago
-
Applied AI Lead USD 140K-180KAPI Integration | Agents | Artificial Intelligence | Assistants | Context engineeringEquity package | Health coverage | Remote-first workplace | Unlimited PTOSenior-level Full TimeRemote - United States or Canada R13h ago
-
Principal Applied AI Engineer USD 185K-245KAgent Frameworks | Agent SDK | Anthropic Agent SDK | Context engineering | EvalsSenior-level Full TimeRedesign Health R13h ago
-
Staff Machine Learning Engineer, Foundation - Seattle USD 208K-298KAWS | Accelerate | Azure | C++ | DeepSpeedExperience bonus | Hybrid work model | QGroup communities | Wellness reimbursementSenior-level Full TimeSeattle, Washington, United States14h ago
-
Active Learning | DPO | Data Privacy | Deep learning | Few-Shot Learning401k match | Family leave | Flexible time away | Health plansSenior-level Full TimeMountain View, CALIFORNIA, United States14h ago
-
API Design | Bottleneck analysis | Debugging | Distributed Systems | Generative AI401k match | ESPP | Family leave programs | Flexible spending accounts | Flexible time offSenior-level Full TimeMountain View, CALIFORNIA, United States14h ago
-
Staff Machine Learning Engineer, Agentic App Platform USD 176K-308KAPI Design | Debugging | Distributed Systems | Generative AI | Language Models401k plan with company match | ESPP | Family leave | Flexible time away | Health plansSenior-level Full TimeMountain View, CALIFORNIA, United States14h ago
-
Staff Machine Learning Engineer, Agentic Application USD 176K-308KAgentic AI | Conversational UI | Generative AI | Language Models | Language Processing401k match | Employee stock purchase plan | Family leave | Flexible spending accounts | Flexible time away programSenior-level Full TimeMountain View, CALIFORNIA, United States14h ago
-
Agentic AI | Conversational UI | Generative AI | LLM Applications | Language Models401k match | Employee stock purchase plan | Family leave programs | Flexible spending accounts | Flexible time offSenior-level Full TimeMountain View, CALIFORNIA, United States14h ago
-
Machine Learning Engineer, Agentic Application USD 139K-216KAPI Design | Distributed Systems | Generative AI | Language Models | Language Processing401k match | ESPP | Family leave | Flexible spending account | Flexible time offEntry-level Full TimeMountain View, CALIFORNIA, United States14h ago
-
C++ | Distributed Training | ETL Pipelines | Go | Hugging Face401k plan | ESPP | Family leave programs | Flexible spending accounts | Flexible time awaySenior-level Full TimeMountain View, CALIFORNIA, United States14h ago
-
Abstractive summarization | Active Learning | DPO | Few-Shot Learning | Few-shotFlexible work persona | Remote work flexibilitySenior-level Full TimeMountain View, CALIFORNIA, United States14h ago
-
Senior-level Full TimeFort Washington, MD; Tampa, FL14h ago
-
Sr. AI/ML Engineer II (6707) USD 212K-248KAWS | Anaconda | CI/CD | Containerization | Data Architecture401k match | Dependent care | Employee Assistance and Wellness Programs | Flexible work arrangements | Health, dental, and vision insuranceMid-level Full TimeTysons Corner, VA14h ago
-
Sr. AI/ML Engineer II (6707) USD 212K-248KAWS | Anaconda | Artificial Intelligence | CI/CD | Containerization401k with company match | Employee Assistance and Wellness Programs | Flexible work arrangements | Health, dental, and vision insurance | Paid time offMid-level Full TimeReston, VA14h ago
-
Sr. AI/ML Engineer II (6707) USD 212K-248KAWS | Anaconda | CI/CD | Containerization | DevSecOps401k match | Company-paid training | Dependent care | Employee assistance wellness programs | Flexible work arrangementsMid-level Full TimeHerndon, VA14h ago
-
Senior Machine Learning Engineer USD 203K-267KAlgorithm Design | Artificial Intelligence | C# | Complexity analysis | Data PipelinesExperience bonus | Hybrid work model | Mental health benefits | Unlimited sick days | Wellness reimbursementSenior-level Full TimeSeattle, Washington, United States15h ago
-
Machine Learning Engineer II USD 167K-220KAlgorithm Design | Artificial Intelligence | C# | Complexity analysis | Data CleansingExperience bonus | Hybrid work model | Mental health benefits | QGroup communities | Unlimited sick daysMid-level Full TimeSeattle, Washington, United States15h ago