62 jobs for Speculative decoding

AI Platform Engineer USD 130K-180K

API Gateway | AWS | Authentication | Authorization | Autoscaling

Career growth | Direct W2 employment | Remote work

Senior-level Full Time

United States - Remote R

2d ago

AI Inference Engineer USD 176K-265K

AWS | Azure | C++ | CUDA | CoreML

Mid-level Full Time

San Jose, United States

3d ago

Senior Inference Engineer, AGI USD 167K-260K

Attention Mechanisms | Autoregressive decoding | BF16 | C++ | CUDA

401k matching | Health insurance | Paid time off | Parental leave

Senior-level Full Time

Sunnyvale, California, USA

3d ago

Senior Software Engineer USD 151K-235K

Auto Scaling | Batch scheduling | C++ | CI/CD | Continuous batching

Flexible work location | Health and wellbeing resources | Paid volunteer days

Senior-level Full Time

Seattle - United States - Seattle, … R

3d ago

Senior Software Engineer - AI Inference Performance USD 184K-287K

Batching | C++ | CUDA | CUDA Graphs | CUDA kernels

Senior-level Full Time

US, CA, Santa Clara

4d ago

Distributed Training & Inference Optimization Engineer (LLM) - GPU Optimization Department (GPUOD) JPY 8000K-10800K

CUDA | Continuous batching | DeepSpeed | Dynamic batching | FSDP

Mid-level Full Time

Rakuten Crimson House, Japan

4d ago

AI Infrastructure Engineer - Recommendation & LLM USD 160K-220K

Algorithms | C++ | CUDA | CUDA graph | Computer Architecture

Senior-level Full Time

San Jose, California, United States

5d ago

AI/ML ASIC Architect INR 3000K-6000K

ARM | ASIC | AXI interconnect | Attention Mechanisms | CUDA

Senior-level Full Time

Bengaluru, KA, India

9d ago

AI/ML ASIC Architect INR 3000K-6000K

ARM | ASIC | AXI | Attention Mechanism | CUDA

Senior-level Full Time

Bengaluru, KA, India

9d ago

Senior Solutions Architect, Inference Service Providers USD 184K-287K

Agent Design | Cache Management | Custom Inference Kernels | Data Curation | DevOps

Senior-level Full Time

US, CA, Santa Clara R

9d ago

Distinguished Software Engineer, AI Software & Platform (Hybrid) USD 293K-406K

AIOps | Agent Orchestration | Agent systems | Arize Phoenix | Braintrust

401k matching | Flexible vacation time off | Life insurance | Long-term disability | Paid Holidays

Senior-level Full Time

Milpitas, California, United States of America R

9d ago

Software Engineer, Inference (AI Data Engineering) USD 135K-175K

Auto Scaling | Batch scheduling | C plus plus | CI/CD | ClickHouse

401k | Dental insurance | Life insurance | Long-term disability insurance | Medical insurance

Entry-level Full Time

Palo Alto, CA R

11d ago

Tech Lead, Machine Learning Engineer - Global E-Commerce (Conversational AI) SGD 150K-199K

AI Feedback | Agent systems | Context engineering | Deep learning | DeepSpeed

Senior-level Full Time

Singapore, Singapore

11d ago

Research Engineer - LLM/VLM Inference Optimization (Seed Infra) USD 241K-456K

C# | C++ | CPU architecture | CUDA | Containerization

401k matching | Dental insurance | Life insurance | Long-term disability | Medical insurance

Mid-level Full Time

Seattle, Washington, United States

11d ago

Research Engineer - LLM/VLM Inference Optimization (Seed Infra) USD 254K-480K

C plus plus | C# | CPU GPU | CPU/GPU profiling | CUDA

Mid-level Full Time

San Jose, California, United States

11d ago

Staff AI Engineer USD 151K-332K

C++ | CUDA | CUDA kernel | CUDA kernel development | Cache Management

Hybrid work | In-person work | Remote work | Work-life balance support

Senior-level Full Time

Seattle (WA), United States R

12d ago

AI Lead Software Architect - SME USD 131K-218K

Asynchronous programming | Autogen | C# | CI/CD | CUDA

Senior-level Full Time

Chantilly/Herndon, VA

13d ago

Senior Inference Engineer, AGI USD 168K-261K

Attention | Autoregressive decoding | CUDA | CUDA kernels | Continuous batching

401k matching | Dental insurance | Health insurance | Mental health support | Paid time off

Senior-level Full Time

Sunnyvale, California, USA

13d ago

Developer Relations Manager, Higher Education and Research - Foundational AI CAD 170K-220K

Attention Optimization | CUDA | Data Generation | Deep learning | Distributed Training

Senior-level Full Time

Canada, Toronto

13d ago

Senior Principal Machine Learning Engineer USD 220K-300K

Co-design | Compiler optimization | Context modeling | Data Curation | Deep learning

Counseling services | Dental insurance | Employee assistance program | Employee equity | Flexible spending account

Senior-level Full Time

San Jose, California, United States

14d ago

Senior Inference Optimization Engineer - Dragonfly Portfolio USD 152K-239K

ASICs | C++ | CUDA | CUDA Graphs | Continuous batching

Remote work

Senior-level Full Time

United States (Remote) R

16d ago

Applied AI Engineer - iCloud Data USD 150K-220K

AI Foundry | Apache Flink | Apache Kafka | Azure AI | Azure AI Foundry

Senior-level Full Time

Cupertino; Seattle

17d ago

Applied AI Engineer - iCloud Data USD 150K-220K

AWS | Agent Frameworks | Agent coordination | Apache Flink | Azure

Senior-level Full Time

Cupertino; Seattle

17d ago

Senior Product Manager – AI Inference Performance USD 208K-327K

Artificial Intelligence | Benchmarking | Inference Optimization | Inference Server | KV cache

Senior-level Full Time

US, CA, Santa Clara

17d ago

Applied Scientist, GenAI & ML Systems USD 175K-215K

APIs | AWS | Azure | Batching | CI/CD

Mid-level Full Time

US - MA - Wilmington

17d ago

Software Engineer, Applied AI Infrastructure USD 193K-352K

Attention | Batching | CI Failure Attribution | Cloud infrastructure | Context handling

Senior-level Full Time

Mountain View, California (HQ)

18d ago

Engineering Manager, ML Performance USD 207K-300K

Auto sharding | Auto-tuning | CUDA | CUDA programming | CUDA runtime

Senior-level Full Time

Sunnyvale, CA, USA; Kirkland, WA, USA

19d ago

Senior Machine Learning Engineer USD 188K-282K

AB Testing | Adversarial Machine Learning | Calibration monitoring | Canary Releases | Closed Loop

Senior-level Full Time

Palo Alto, CA

19d ago

AI Researcher USD 295K-445K

Cache Compression | Deep learning | Direct Preference Optimization | Experiment design | Fine Tuning

Fast Hiring Response | Immigration support | In person Work Mode | Permission to Publish | Relocation support

Senior-level Full Time

San Francisco Office

20d ago

Performance Engineer, Inference INR 4000K-6000K

C++ | CUDA | Copy-on-write | Disaggregated Prefill | Disaggregated prefill decode

Senior-level Full Time

Bengaluru R

20d ago

Staff Software Engineer, Inference GBP 116K-155K

Autoscaling | BF16 | Benchmarking | C++ | CUDA

Critical illness cover | Employee assistance programme | Family dental insurance | Family medical insurance | Life assurance

Senior-level Full Time

London, England

23d ago

DL Performance Software Engineer - LLM Inference CAD 135K-185K

Algorithms | Autotuning | C plus plus | CUDA | Computer Architecture

Mid-level Full Time

Canada, Toronto

24d ago

Forward Deployed Engineer (Inference & Post-Training) - Mandarin Speaking SGD 150K-205K

DPO | Fine Tuning | GRPO | KV cache | LoRA

Health insurance | Remote work flexibility | Startup equity

Senior-level Full Time

Singapore

25d ago

Senior Machine Learning Engineer, Jockey Core

Autoscaling | Batching | Capacity Planning | Disaggregated Prefill | Disaggregated prefill decode

Conference allowance | English education program | Equipment stipend | Flu vaccination support | Global buddy program

Senior-level Full Time

Seoul, South Korea

26d ago

AI/ML ASIC Architect USD 163K-235K

ARM | ASIC architecture | AXI interconnect | Area Optimization | Attention Mechanisms

Senior-level Full Time

Milpitas, CA, United States

26d ago

AI/ML ASIC Architect USD 163K-235K

ARM | ASIC | AXI | Area analysis | Attention Mechanisms

Senior-level Full Time

Milpitas, CA, United States

26d ago

Senior Developer Relations Manager INR 3000K-5500K

AI Enterprise | APIs | Batching | C++ | CI/CD

Senior-level Full Time

India, Bengaluru

27d ago

Senior Deep Learning Researcher, LLM Inference

Algorithm Optimization | Deep learning | GPU Computing | HPC | High Performance

Senior-level Full Time

Israel, Tel Aviv

27d ago

Engineering Manager – AI Engineering BRL 1000K

Autoscaling | C++ | CUDA | DeepSpeed | Distributed Training

Mid-level Full Time

Bangalore, Karnataka

30d ago

[Lta-Tro] Senior/ Executive/ Ai Software Developer - Transport Ai Programme SGD 120K-156K

AWS | Agentic Systems | Azure | CI/CD | Computer Vision

Senior-level Full Time

LTA ITSC L4, Singapore

30d ago

Applied AI Engineer, Inference USD 188K-275K

Batching | Benchmarking | CUDA | GPU Utilization | Graph Capture

401k employer match | Disability insurance | Employee stock purchase program | Flexible PTO | Flexible spending account

Mid-level Full Time

Bellevue, WA/ San Francisco, CA/ Sunnyvale, …

1mo ago

Research Manager | Production Inference GBP 100K-178K

Autoscaling | Efficiency Improvements | Hardware utilization | Inference Optimization | LLM Inference

Annual leave | Flexible hours | Hybrid work | In-person team events | Mental health resources

Mid-level Full Time

London

1mo ago

Senior Lead Software Engineer - LLM Ops Platform Reliability GBP 84K-109K

Amazon SageMaker | Autoscaling | Capacity Planning | Cause analysis | Cloud infrastructure

Senior-level Full Time

GLASGOW, LANARKSHIRE, United Kingdom

1mo ago

AI Researcher - Efficient AI (Contractor) USD 90K-114K

Agent systems | Cache Compression | DPO | Distillation | Hybrid Attention

401k matching | Fitness Goal Incentives | Health, dental, vision insurance | Hybrid work | Life and disability insurance

Entry-level Contract

Santa Clara, CA R

1mo ago

NLP Performance Engineer GBP 100K-140K

Benchmarking | CUDA | KV cache | LLM Inference | Language Models

Annual leave | Barista service | Company pension | Cycle to work scheme | Healthcare

Mid-level Full Time

London, United Kingdom

1mo ago

Senior Applied Scientist, Efficient LLM Inference & Model Optimization USD 195K-262K

CUDA | Cache Compression | Co Optimization | Decoding algorithms | Evaluation methodology

401k plan | Career growth and learning opportunities | Collaborative culture | Disability insurance | Flexible work arrangements

Senior-level Full Time

Palo Alto, California, United States

1mo ago

Machine Learning Engineer — Inference Optimization USD 170K-287K

BF16 | CUDA | Deep learning | Distributed Systems | FP16

Senior-level Full Time

Remote (world) R

1mo ago

Senior Inference Runtime Engineer TWD 1900K-2500K

CUDA | CUDA profiling | Continuous batching | Distributed inference | GPU Memory Optimization

Flexible work culture | Inclusive environment | Training and mentoring

Senior-level Full Time

Singapore, SG / Penang, MY / …

1mo ago

AI Inference Engineer GBP 80K-106K

Autoscaling | Batching | CUDA | Cache Management | Capacity Planning

Biannual bonus | Breakfast allowance | Dinner allowance | Equity sign-on bonus | Expensed technology

Mid-level Full Time

London, England, United Kingdom - Remote R

1mo ago

Senior Software Engineer I, Inference USD 139K-204K

Adaptive scheduling | Autoscaling | BF16 | C++ | CI/CD

401k match | Dental insurance | Disability insurance | Employee stock purchase program | Flexible PTO

Senior-level Full Time

Sunnyvale, CA / Bellevue, WA

1mo ago

Find jobs in AI/ML, Data Science and Big Data