Staff Engineer, Inference Optimizations
Tasks
- Advise on GPU software stack integration
- Benchmark inference engine and GPU kernels
- Conduct technical code reviews and design reviews
- Develop and deploy quantization techniques
- Implement kernel fusion
- Lead inference performance architecture
- Manage precision for inference
- Optimize attention layer performance
- Optimize memory access patterns
- Parallelize inference across multi node GPU clusters
- Perform systems design for low level GPU programming
- Tune MoE expert gateway router kernels
- Tune batch size performance
Perks/Benefits
- Conference reimbursement
- Education reimbursement
- Employee assistance program
- Flexible time off
- LinkedIn Learning
- Training reimbursement
Skills/Tech-stack
Attention Mechanisms | BF16 | CUDA | CUDA kernels | Distributed Systems | FP4 | FP8 | FlashAttention | GPU Kernel | GPU kernel optimization | High Performance | High-Performance Computing | INT8 | Kernel Fusion | Kernel optimization | MOE | Mixture of Experts | Parallelization | Performance Computing | Quantization | RMS Norm | ROCm | TensorRT | Triton
Education
N/A
Regions
Countries
States
Cities
Related jobs
-
Senior Software Engineer (Storage) - remote in the US USD 100K-150KArgo CD | ArgoCD | Block Storage | CSI | Cluster APISenior-level Full TimeBoston, MA, United States R13h ago
-
Machine Learning Research Engineer USD 200K-330KAWS | Azure | Benchmarking | CUDA | DDP401k match | Dental insurance | Health insurance | Paid time off | Vision insuranceMid-level Full TimeEmeryville, California, United States; Hybrid (2-3 … R16h ago
-
Staff Engineer, Inference Optimizations USD 191K-239KBF16 | Bandwidth Optimization | CUDA | Expert Routing | FP4Conference reimbursement | Education reimbursement | Employee assistance program | Flexible time off | LinkedIn Learning accessSenior-level Full TimeDenver R16h ago
-
Staff Engineer, Inference Optimizations USD 191K-239KAMD GPU | Attention Optimization | Bandwidth Optimization | Benchmarking | CUDAConference reimbursement | Employee assistance program | Flexible time off | LinkedIn Learning access | Local Employee MeetupsSenior-level Full TimeAustin R16h ago
-
Staff Engineer, Inference Optimizations USD 191K-239KAttention Optimization | BF16 | CUDA | FP4 | FP8Conference reimbursement | Education reimbursement | Employee assistance program | Employee stock purchase program | Equity compensationSenior-level Full TimeSan Francisco R16h ago
-
Senior Software Engineer I - AI Inference Data Plane USD 139K-174KAutoscaling | Continuous batching | Data parallelism | Distributed Systems | GRPCConference reimbursement | Education reimbursement | Employee assistance program | Employee stock purchase program | Equity compensationSenior-level Full TimeAustin R17h ago
-
Senior Engineer, Inference Data Plane USD 139K-174KContinuous batching | Data parallelism | Distributed Systems | GRPC | GoEmployee assistance program | Employee stock purchase program | Equity compensation | Flexible time off | LinkedIn Learning accessSenior-level Full TimeDenver R17h ago
-
Senior Engineer, Inference Data Plane USD 139K-174KContinuous batching | Data parallelism | Distributed Systems | GRPC | GoConference reimbursement | Employee assistance program | Employee stock purchase program | Equity compensation | Flexible time offSenior-level Full TimeBoston R17h ago
-
Senior Software Engineer I - AI Inference Data Plane USD 139K-174KAutoscaling | Continuous batching | Data parallelism | Distributed Systems | GRPCConference reimbursement | Employee assistance program | Employee stock purchase program | Equity compensation | Flexible time offSenior-level Full TimeSan Francisco R17h ago
-
Senior Software Engineer, Data Layer USD 186K-218KAPI Platform | Caching | Distributed Systems | Go | GraphQL401k | Dental insurance | Medical insurance | Quarterly in person surges | Remote-firstSenior-level Full TimeRemote - USA R19h ago
-
Scientific Computing and Data Management SME USD 150K-185KAgile | Data Lifecycle Management | Data Security | Data lifecycle | DevOpsPublic Trust Clearance | Remote work | Security clearance based access | Travel as neededSenior-level Full TimeWork from home, VA, United States R20h ago
-
Senior AI ML Software Engineer - Data Platforms - Remote Nationwide or Hybrid in MN or DC USD 120K-214KAI Agents | AWS | Artificial Intelligence | Automated testing | AzureSenior-level Full TimeEden Prairie, Minnesota, UNITED STATES; REMOTE R1d ago
-
Senior Embedded Software Engineer - Future Forward USD 134K-201KAuthentication | C# | C++ | CAN | CUDASenior-level Full TimeSunnyvale, CA, United States R1d ago
-
Product Engineer – Analytics as a Service USD 65K-120KAI Assisted Development | API Development | AWS | Agile | AnalyticsMid-level Full TimeRochester, NY, United States R1d ago
-
Behavioral Data | Data Pipelines | Data Quality | Distributed Systems | Evaluation metricsGlobal annual leave policy | In-person onboarding | Remote work | Restricted stock units (RSUs)Senior-level Full TimeUnited States (Remote) R1d ago
-
Computational Biology MLOps Engineer USD 125K-189KAWS | Alerting | CI/CD | Checkpointing | Cloud platformOnsite work three days per weekMid-level Full TimeSan Diego, CA / Indianapolis, IN … R2d ago
-
Sr Data Engineer USD 91K-163KAI/ML | Azure DevOps | CI/CD | Code review | Data Compliance401k contribution | Career development opportunities | Comprehensive benefits | Incentive and recognition programsSenior-level Full TimeEden Prairie, Minnesota, UNITED STATES; REMOTE R2d ago
-
API | Acoustic Echo Cancellation | Automated testing | Beamforming | BehaviorTree.CPPAnnual bonus | Dental insurance | Disability insurance | Equity awards | Health insuranceSenior-level Full TimeRemote - USA, United States R2d ago
-
Lead Machine Learning Engineer USD 172K-276KAmazon Web Services | Azure | CI/CD | Cloud platform | DatabricksLearning and development programs | Mentorship and coachingSenior-level Full TimeChicago, Illinois, USA R2d ago
-
Staff Backend Engineer, AI Systems USD 181K-226KAPIs | Asynchronous processing | Azure OpenAI | Context retrieval | Distributed SystemsBenefits | Remote-first workSenior-level Full TimeUnited States Remote R2d ago
-
Principal Data Engineer USD 135K-180KAWS | Airflow | Auditability | CI/CD | DBTCell phone allowance | Comprehensive health coverage | Equity grants | Home office setup allowance | Performance bonusesSenior-level Full TimeRemote US R2d ago
-
Asynchronous training | Containerization | Curriculum learning | Distributed Systems | Distributed TrainingSenior-level Full TimeSF Bay Area, CA, Remote, US, … R2d ago
-
Principal Machine Learning Engineer, Content Safety USD 295K-345KComputer Vision | Content Moderation | Data Pipelines | Deep learning | Language ModelsEquity compensationSenior-level Full TimeSan Mateo, CA, United States R3d ago
-
Sr Staff Software Engineer- Data Platform USD 220K-255KAWS EMR | AWS Lambda | AWS S3 | Access Control | AlgorithmsDental insurance | Disability insurance | Flexible spending account | Health insurance | Health savings accountSenior-level Full TimeCalifornia - Remote Office, United States R3d ago
-
Big Data Engineer USD 100K-150KAWS EMR | Airflow | Alerting | Apache Spark | Azure HDInsightRemote workSenior-level Full TimeUnited States - Remote R3d ago