65 jobs for Speculative decoding

Performance Engineer, Inference INR 4000K-6000K

C++ | CUDA | Copy-on-write | Disaggregated Prefill | Disaggregated prefill decode

Senior-level Full Time

Bengaluru R

10h ago

Staff Software Engineer, Inference GBP 116K-155K

Autoscaling | BF16 | Benchmarking | C++ | CUDA

Critical illness cover | Employee assistance programme | Family dental insurance | Family medical insurance | Life assurance

Senior-level Full Time

London, England

3d ago

ML Platform Engineer USD 100K-160K

API Gateway | Abuse detection | Autoscaling | C++ | Caching

Senior-level Full Time

Lexington, MA R

4d ago

ML Performance Engineer USD 100K-150K

Benchmarking | C++ | CUDA | Continuous batching | Cutlass

Senior-level Full Time

Phoenix — Ahwatukee, AZ R

4d ago

Inference Performance Engineer, AI Inference Configuration Optimization USD 124K-195K

C++ | CUDA | CUPTI | Continuous batching | KV cache

Senior-level Full Time

US, CA, Santa Clara R

4d ago

DL Performance Software Engineer - LLM Inference CAD 135K-185K

Algorithms | Autotuning | C plus plus | CUDA | Computer Architecture

Mid-level Full Time

Canada, Toronto

4d ago

Senior Software Engineer – TensorRT Edge-LLM USD 152K-241K

Attention | C++ | CUDA | Compiler optimization | FlashInfer

Senior-level Full Time

US, CA, Santa Clara R

5d ago

Forward Deployed Engineer (Inference & Post-Training) - Mandarin Speaking SGD 150K-205K

DPO | Fine Tuning | GRPO | KV cache | LoRA

Health insurance | Remote work flexibility | Startup equity

Senior-level Full Time

Singapore

5d ago

Senior Machine Learning Engineer, Jockey Core

Autoscaling | Batching | Capacity Planning | Disaggregated Prefill | Disaggregated prefill decode

Conference allowance | English education program | Equipment stipend | Flu vaccination support | Global buddy program

Senior-level Full Time

Seoul, South Korea

6d ago

AI/ML ASIC Architect USD 163K-235K

ARM | ASIC architecture | AXI interconnect | Area Optimization | Attention Mechanisms

Senior-level Full Time

Milpitas, CA, United States

6d ago

AI/ML ASIC Architect USD 163K-235K

ARM | ASIC | AXI | Area analysis | Attention Mechanisms

Senior-level Full Time

Milpitas, CA, United States

6d ago

Senior Developer Relations Manager INR 3000K-5500K

AI Enterprise | APIs | Batching | C++ | CI/CD

Senior-level Full Time

India, Bengaluru

7d ago

Senior Deep Learning Researcher, LLM Inference

Algorithm Optimization | Deep learning | GPU Computing | HPC | High Performance

Senior-level Full Time

Israel, Tel Aviv

7d ago

AI Platform Engineer USD 130K-180K

API Gateways | AWS | Alerting | Authentication | Authorization

Senior-level Full Time

United States - Remote R

7d ago

AI Research Engineer USD 122K-184K

Attention | Batching | Deep learning | Generative AI | Hardware-in-the-loop

Mid-level Full Time

Hà Nội, Vietnam

7d ago

Engineering Manager – AI Engineering BRL 1000K

Autoscaling | C++ | CUDA | DeepSpeed | Distributed Training

Mid-level Full Time

Bangalore, Karnataka

10d ago

[Lta-Tro] Senior/ Executive/ Ai Software Developer - Transport Ai Programme SGD 120K-156K

AWS | Agentic Systems | Azure | CI/CD | Computer Vision

Senior-level Full Time

LTA ITSC L4, Singapore

10d ago

Applied AI Engineer, Inference USD 188K-275K

Batching | Benchmarking | CUDA | GPU Utilization | Graph Capture

401k employer match | Disability insurance | Employee stock purchase program | Flexible PTO | Flexible spending account

Mid-level Full Time

Bellevue, WA/ San Francisco, CA/ Sunnyvale, …

10d ago

Staff/Principal DevOps Engineer, AI Inference USD 192K-272K

AWS IAM | AWS S3 | Amazon EC2 | Amazon EKS | Amazon VPC

Commuter benefits | Company Subsidized Lunch Program | Company holidays | Dental insurance | Educational assistance

Senior-level Full Time

Cambridge, MA USA

13d ago

Tech Lead, Machine Learning Engineer - Global E-Commerce (Conversational AI) SGD 160K-205K

AI Feedback | Context engineering | Data Curation | Deep learning | DeepSpeed

Senior-level Full Time

Singapore, Singapore

13d ago

Research Manager | Production Inference GBP 100K-178K

Autoscaling | Efficiency Improvements | Hardware utilization | Inference Optimization | LLM Inference

Annual leave | Flexible hours | Hybrid work | In-person team events | Mental health resources

Mid-level Full Time

London

14d ago

Senior Lead Software Engineer - LLM Ops Platform Reliability GBP 84K-109K

Amazon SageMaker | Autoscaling | Capacity Planning | Cause analysis | Cloud infrastructure

Senior-level Full Time

GLASGOW, LANARKSHIRE, United Kingdom

14d ago

Staff AI Engineer USD 151K-332K

C plus plus | CUDA | CUDA kernels | Continuous batching | FP8

Senior-level Full Time

Seattle (WA), United States

14d ago

AI Researcher - Efficient AI (Contractor) USD 90K-114K

Agent systems | Cache Compression | DPO | Distillation | Hybrid Attention

401k matching | Fitness Goal Incentives | Health, dental, vision insurance | Hybrid work | Life and disability insurance

Entry-level Contract

Santa Clara, CA R

16d ago

NLP Performance Engineer GBP 100K-140K

Benchmarking | CUDA | KV cache | LLM Inference | Language Models

Annual leave | Barista service | Company pension | Cycle to work scheme | Healthcare

Mid-level Full Time

London, United Kingdom

18d ago

Senior Machine Learning Engineer, LLM Inference Optimization USD 195K-262K

AWQ | Benchmarking | CUDA | CUDA kernels | Chunked prefill

401k match | Career growth | Collaborative culture | Disability insurance | Flexibility

Senior-level Full Time

Palo Alto, California, United States

18d ago

Senior Applied Scientist, Efficient LLM Inference & Model Optimization USD 195K-262K

CUDA | Cache Compression | Co Optimization | Decoding algorithms | Evaluation methodology

401k plan | Career growth and learning opportunities | Collaborative culture | Disability insurance | Flexible work arrangements

Senior-level Full Time

Palo Alto, California, United States

18d ago

Intern - GenAI Benchmarking (MLE) / On-Device Model Deployment (SWE) KRW 45000K-67000K

AIMet | Automated testing | Executorch | Git | Hugging Face

Entry-level Internship

Seoul, Korea, Republic of

19d ago

Machine Learning Engineer — Inference Optimization USD 170K-287K

BF16 | CUDA | Deep learning | Distributed Systems | FP16

Senior-level Full Time

Remote (world) R

20d ago

Senior Inference Runtime Engineer TWD 1900K-2500K

CUDA | CUDA profiling | Continuous batching | Distributed inference | GPU Memory Optimization

Flexible work culture | Inclusive environment | Training and mentoring

Senior-level Full Time

Singapore, SG / Penang, MY / …

21d ago

AI Inference Engineer GBP 80K-106K

Autoscaling | Batching | CUDA | Cache Management | Capacity Planning

Biannual bonus | Breakfast allowance | Dinner allowance | Equity sign-on bonus | Expensed technology

Mid-level Full Time

London, England, United Kingdom - Remote R

21d ago

Senior Software Engineer I, Inference USD 139K-204K

Adaptive scheduling | Autoscaling | BF16 | C++ | CI/CD

401k match | Dental insurance | Disability insurance | Employee stock purchase program | Flexible PTO

Senior-level Full Time

Sunnyvale, CA / Bellevue, WA

24d ago

Senior Director, Inference Products and Optimizations USD 274K-343K

AI workload | AI workload orchestration | AMD GPU | CUDA | Container Runtime

Conference reimbursement | Education reimbursement | Employee assistance program | Employee stock purchase program | Equity compensation

Senior-level Full Time

Seattle

25d ago

Agentic AI Engineer (LLM) USD 106K-181K

A/B | A/B Testing | API Development | Agent Orchestration | Autogen

Annual health check-ups | Opportunity to collaborate and learn from industry professionals | Performance bonuses | Preferential pricing for services | Premium healthcare package

Mid-level Full Time

Hanoi, Vietnam

26d ago

Staff Software Engineer, Beyond Live, DeepMind USD 207K-301K

2D Games | 3D Games | Audio Tokenization | Audio video pacing | Audio/Video

Senior-level Full Time

New York, NY, USA; Mountain View, …

26d ago

Senior Staff Engineer, GDC AI Inference Platform USD 262K-365K

Agent coordination | C++ | Cloud infrastructure | Containerization | Data Structures

Bonus | Equity | Health insurance | Paid time off | Retirement plans

Senior-level Full Time

Sunnyvale, CA, USA; Kirkland, WA, USA

26d ago

ML Framework (MetalLM) Engineer USD 175K-312K

C# | C++ | CUDA | Compiler optimization | Compression

Senior-level Full Time

Cupertino

27d ago

Software Engineer, AI Specialist - Wearables AI (Technical Leadership) USD 147K-208K

C plus plus | CI/CD | Cloud Computing | Computer Vision | Deep learning

Senior-level Full Time

Burlingame, CA

30d ago

Senior AI Engineer – Enterprise Data & AI USD 196K-294K

AWS Bedrock | Agentic Workflows | Arize | Autogen | Data Privacy

Senior-level Full Time

Foster City, CA

1mo ago

Machine Learning Engineer - Model Inference USD 166K-230K

C++ | Cloud infrastructure | Containers | Continuous batching | Distributed Systems

Mid-level Full Time

Cupertino

1mo ago

AI Engineer (Managed Services) SGD 85K-138K

A/B | A/B Testing | AWQ | AutoAWQ | B testing

Mid-level Full Time

Singapore

1mo ago

Tech Lead Manager, Inference USD 207K-300K

Autoscaling | Cache Management | Caching | Continuous batching | Deployment Pipelines

Senior-level Full Time

SF Bay Area, CA

1mo ago

Software Engineer - Training/Inference (C++) USD 180K-440K

Auto Scaling | C++ | CI/CD | CUDA | Code generation

401k plan | Dental insurance | Disability insurance | Discounts | Health insurance

Senior-level Full Time

Palo Alto, CA

1mo ago

Lead Software Engineer – LLM Ops Platform Reliability GBP 80K-110K

AWS | Alertmanager | Amazon EKS | Amazon SageMaker | Autoscaling

Senior-level Full Time

GLASGOW, LANARKSHIRE, United Kingdom

1mo ago

LLM Engineer (Optimization)

Benchmarking | C++ | CUDA | Cache Compression | Inference Optimization

Senior-level Full Time

Pangyo (Software Dream Center), South Korea

1mo ago

Staff ML Engineer, Fine Tuning - Slack USD 197K-344K

Deep learning | GPU infrastructure | Go | Hybrid Retrieval Generation | Hybrid retrieval

401k | Dental insurance | Employee stock purchasing program | Life and disability insurance | Medical insurance

Senior-level Full Time

Washington - Seattle, United States

1mo ago

Member of Technical Staff - Inference Research USD 150K-350K

Autoscaling | Disaggregated Prefill | FP8 | INT4) | KV cache

In-person collaboration

Senior-level Full Time

New York

1mo ago

Senior Software Engineer, Inference USD 152K-204K

BF16 | C++ | CI/CD | CUDA | CUDA kernels

401k employer match | Company paid life insurance | Employee stock purchase program | Flexible PTO | Flexible spending account

Senior-level Full Time

Sunnyvale, CA / Bellevue, WA

1mo ago

Senior ML Engineer (Token Factory) GBP 80K-130K

CI/CD | Distributed Training | Inference Optimization | JAX | JAX Speculative Decoding

Career growth and learning opportunities | Collaborative culture | Flexibility | International environment | Ownership

Senior-level Full Time

Germany; Israel; Netherlands; Prague, Czech Republic; … R

1mo ago

Principal LLM Inference Engineer USD 195K-285K

Batching | C# | C++ | CUDA | CUDA kernel

Equity | Flexible working hours | Health insurance | Paid time off

Senior-level Full Time

Santa Clara

1mo ago

Find jobs in AI/ML, Data Science and Big Data