Staff Engineer, Inference Optimizations
Tasks
- Advise on GPU software stack integration
- Benchmark inference engine and GPU kernels
- Conduct technical code reviews and design reviews
- Develop and deploy quantization techniques
- Implement kernel fusion
- Lead inference performance architecture
- Manage precision for inference
- Optimize attention layer performance
- Optimize memory access patterns
- Parallelize inference across multi node GPU clusters
- Perform systems design for low level GPU programming
- Tune MoE expert gateway router kernels
- Tune batch size performance
Perks/Benefits
- Conference reimbursement
- Education reimbursement
- Employee assistance program
- Flexible time off
- LinkedIn Learning
- Training reimbursement
Skills/Tech-stack
Attention Mechanisms | BF16 | CUDA | CUDA kernels | Distributed Systems | FP4 | FP8 | FlashAttention | GPU Kernel | GPU kernel optimization | High Performance | High-Performance Computing | INT8 | Kernel Fusion | Kernel optimization | MOE | Mixture of Experts | Parallelization | Performance Computing | Quantization | RMS Norm | ROCm | TensorRT | Triton
Education
N/A
Regions
Countries
States
Cities
Related jobs
-
Senior Machine Learning Engineer, Ads ML Platform USD 216K-303KAnomaly Detection | Data Governance | Data Infrastructure | Data Lineage | Data Storage401k employer match | Caregiving support | Comprehensive healthcare benefits | Family planning support | Flexible remote workSenior-level Full TimeRemote - United States R15h ago
-
Senior Software Engineer - Storage Control Plane USD 266K-395KBlock Storage | C# | C++ | CI/CD | CephSenior-level Full TimeSan Francisco Office (Fremont St) R16h ago
-
A/B | A/B Testing | B testing | C++ | Cloud Computing401k employer match | Family planning support | Flexible vacation | Gender-affirming care | Global benefitsSenior-level Full TimeRemote - United States R17h ago
-
AI Assisted Query Profiling | AI assisted code | AI-assisted code review | ClickHouse | Code reviewSenior-level Full TimeUnited States R18h ago
-
Software Engineer, Data Infrastructure - AI Platform USD 200K-230KAI-assisted tooling | ClickHouse | Data Pipelines | Debugging | Distributed SystemsSenior-level Full TimeUnited States R18h ago
-
Staff Data Platform Engineer - AI Platform USD 200K-230KClickHouse | Compliance | Data Pipelines | Debugging | Distributed SystemsSenior-level Full TimeUnited States R18h ago
-
Senior Data Platform Engineer - AI Platform USD 200K-230KAI code review | AI-assisted debugging | ClickHouse | Code review | Data Pipeline ReliabilitySenior-level Full TimeUnited States R18h ago
-
Data Platform Engineer - AI Platform USD 200K-230KClickHouse | Data Pipelines | Distributed Systems | Incident Response | Log AnalysisSenior-level Full TimeUnited States R18h ago
-
Senior Software Engineer, Data Platform USD 196K-245KAirflow | BigQuery | Cost Optimization | Dagster | Data GovernanceBenefits | Equity | Relocation assistanceSenior-level Full TimeSan Francisco Bay Area or Remote … R20h ago
-
Senior Research Engineer, LLM Training & Post-Training USD 165K-310KCUDA | DPO | DeepSpeed | Distributed Training | Experiment design401k matching | Company holidays | Comprehensive health coverage | Dental coverage | Flexible time offSenior-level Full TimeNew York, New York, United States; … R20h ago
-
Staff Data Engineer - AI Platform USD 200K-230KAI Assisted Query Profiling | AI assisted code | AI-assisted code review | ClickHouse | Code reviewSenior-level Full TimeUnited States R20h ago
-
Senior Data Engineer - AI Platform USD 200K-230KClickHouse | Data Pipeline Reliability | Data pipeline | Debugging | Distributed SystemsSenior-level Full TimeUnited States R20h ago
-
Senior Software Development Engineer - Iris AI USD 130K-162K.NET | API Design | Amazon Bedrock | Anthropic API | Asynchronous ArchitectureEmployee assistance program | Health insurance | Life insurance | Paid Company Holidays | Paid time offSenior-level Full TimeU.S. Remote R22h ago
-
Argo CD | Big Data | Concurrency | Distributed Systems | Fine TuningEntry-level Full TimeAustin R22h ago
-
Applied AI Engineer USD 171K-257KAMD | Agentic Systems | Alignment Frameworks | CRM | ContainerizationCompany-sponsored team events | Flexible time off | Travel opportunities | Wellness resourcesSenior-level Full TimeRemote, United States R23h ago
-
Senior AI Engineer – AI Platform USD 140K-160KAWS | Agentic AI | Alerting | Alignment | Distributed SystemsDaily meal specials | Dry cleaning | Free shuttle transportation | Gourmet cafeteria | Group fitness classesSenior-level Full TimeEnglewood Cliffs, NEW JERSEY, United States R1d ago
-
Principal AI Engineer USD 208K-260KAWS | Amazon SageMaker | Autogen | Cloud platform | CrewAI401k savings plan | Dental insurance | Disability insurance | Discretionary bonus eligibility | Life insuranceSenior-level Full TimeRemote, United States R1d ago
-
Data Engineer (Hybrid) USD 86K-165KAWS | AWS Glue | Access Control | Agile | Amazon EMR401k matching | Adoption Assistance | Child and elder care services | Disability coverage | Employee assistance planMid-level Full TimeUS-IA-CEDAR RAPIDS-193 ~ 1120 Collins Rd … R1d ago
-
Anomaly Detection | Batch Processing | Cause analysis | Compute efficiency | Cost Optimization401k employer match | Flexible time off | Health plans | Mental health support | Paid time offSenior-level Full TimeUSA - Remote, United States R1d ago
-
AI/ML Engineer, Lead USD 128K-292KAWS | Agent Orchestration | Agentic AI | Autonomous Agents | AzureDependent care | Paid leave | Professional development | Tuition assistance | Work-life programsSenior-level Full TimeUSA, VA, Ashburn (22001 Loudoun County … R1d ago
-
Senior Data Platform Engineer USD 130K-252KAI | Batch Processing | BigQuery | Canonical Data | Canonical Data Model401k matching | Dental coverage | Flexible schedules | Medical coverage | Paid parental leaveSenior-level Full TimeMidvale, UT, United States R1d ago
-
Edge AI Engineer USD 100K-155KArchitecture Optimization | Bias Evaluation | C++ | Core ML | DSPRemote workSenior-level Full TimeUnited States - Remote R1d ago
-
Senior-level Full TimeUnited States - Remote R1d ago
-
Machine Learning Infrastructure Engineer USD 105K-143KAutoscaling | C++ | Capacity Planning | Distributed Systems | FinOpsSenior-level Full TimeUnited States - Remote R1d ago
-
MLOps Engineer USD 100K-150KAPI Gateway | Abuse detection | Access Management | Automated rollback | AutoscalingSenior-level Full TimeUnited States - Remote R1d ago