49 jobs for Speculative decoding

[SX/EIT-MM] AI/Agent Engineer USD 147K-167K

Agent coordination | Agentic Systems | Async Programming | Audio Processing | CI/CD

Senior-level Full Time

Thành phố Hồ Chí Minh, Hồ …

1d ago

Senior Forward Deployed Engineer II (AI/ML) INR 1800K-3500K

Agents SDK | CUDA | Cache optimization | Continuous batching | CrewAI

Mid-level Full Time

Bengaluru

2d ago

Senior Forward Deployed Engineer I (AI/ML) INR 3000K-4800K

Agents SDK | CUDA | Continuous batching | CrewAI | Data Compression

Hybrid work | Travel up to 30%

Senior-level Full Time

Bengaluru

3d ago

Engineering Manager, ML Performance USD 207K-301K

Auto sharding | Benchmarking | CUDA | CUDA Performance | Compiler optimization

Senior-level Full Time

Sunnyvale, CA, USA; Kirkland, WA, USA

4d ago

AI Software Engineer USD 151K-332K

C++ | CUDA | CUDA kernels | CUDA profiling | Cache Management

Community involvement | Health benefits | Hybrid work options | In-person work options | Remote work options

Mid-level Full Time

Seattle (WA), United States

5d ago

ML Platform Engineer USD 100K-150K

API Gateway | Abuse detection | Automated rollback | Autoscaling | Batching

Remote work

Senior-level Full Time

United States - Remote R

5d ago

Applied AI Scientist - On Site EUR 54K-86K

C++ | CUDA | Computer Vision | Deep learning | Distributed Training

On-site work

Senior-level Full Time

München, BY, DE

5d ago

Applied AI Scientist - On Site

C++ | Computer Vision | Deep learning | Distributed Training | Efficient Inference

Core research and development team | On-site work

Senior-level Full Time

Tel Aviv-Yafo, Tel Aviv District, IL

5d ago

MaaS 架构师 CNY 240K-480K

Attention | Batching | C++ | CUDA | Continuous batching

Senior-level Full Time

上海、北京

7d ago

AI Performance Optimization Engineer USD 100K-150K

Benchmarking | C++ | CUDA | Continuous batching | Cutlass

Remote work

Mid-level Full Time

United States - Remote R

8d ago

AI Performance Optimization Engineer USD 100K-150K

Access Optimization | Attention Mechanisms | Benchmarking | C plus plus | CPU

Mid-level Full Time

United States - Remote R

8d ago

EDB-IPP Project: Advancing GPU Optimization for Large Language Models SGD 60K-120K

Continuous batching | Data parallelism | Deep learning | Distributed Training | Dynamic Memory

Computational resources access | Full sponsorship | Hired by Rakuten Asia after completion | Research exchanges

Mid-level Full Time

Crimson House Singapore

11d ago

Application Software Engineer, Inference USD 135K-185K

Agent Orchestration | Agent SDK | Auto Scaling | Batch scheduling | C++

401k plan | Employee stock purchase plan | Long-term incentives | Medical, dental & vision coverage | Onsite Palo Alto

Entry-level Full Time

Palo Alto, CA

11d ago

Sr GenAI Infra Specialist SA, AWS WWSO Startup USD 153K-228K

AWS Inferentia | AWS Trainium | Amazon Web Services | Batching | CUDA

Senior-level Full Time

New York, New York, USA

12d ago

AI Engineer EUR 60K-80K

AWQ | AWS | Agent SDK | CI/CD | CUDA

Career growth opportunities | Permanent employment | Remote work option

Mid-level Full Time

Remote - Paris, France R

13d ago

Senior Machine Learning Engineer USD 188K-282K

Adversarial Training | Calibration monitoring | Continuous batching | DPO | Deep learning

Senior-level Full Time

Palo Alto, CA

14d ago

Sr. Software Engineer, Inference PLN 321K-470K

Autoscaling | BF16 | C++ | CI/CD | CUDA

Critical illness cover | Employee assistance programme | Family dental insurance | Family medical insurance | Life assurance

Senior-level Full Time

Warsaw, Poland

14d ago

LLM Inference Frameworks and Optimization Engineer USD 160K-230K

C++ | CUDA | CUDA graph | Cluster scheduling | Compiler

Equity | Health insurance

Mid-level Full Time

San Francisco, Singapore, Amsterdam

14d ago

Sr. Staff Machine Learning Researcher - Model Training & Optimization CAD 100K-500K

Deep learning | Distributed Training | Flash Attention | Inference Optimization | Kernel Fusion

Hybrid work

Senior-level Full Time

Toronto, Ontario, Canada

17d ago

Research Intern, Inference (Fall 2026) USD 116K-126K

CUDA | Deep learning | Distributed Systems | JAX | Machine Learning

Housing stipend | Open source contribution opportunities

Entry-level Internship

San Francisco

17d ago

Staff Software Engineer, Inference PLN 369K-542K

Autoscaling | BF16 | Benchmarking | C++ | CUDA

Critical illness cover | Employee assistance programme | Family dental insurance | Family medical insurance | Generous pension contribution

Senior-level Full Time

Warsaw, Poland

18d ago

[SX/EIT-MM] Senior AI/Agent Engineer USD 150K-197K

A/B | A/B Testing | Async Programming | Attention Mechanism | Audio Processing

Senior-level Full Time

Thành phố Hồ Chí Minh, Hồ …

19d ago

AI Engineer USD 100K-135K

AWQ | AWS | AWS EC2 | Agent Frameworks | CI/CD

401k match | Health insurance | Learning and development stipend | Paid parental leave | Paid time off

Mid-level Full Time

Remote USA - In Tandem R

19d ago

ML Research Scientist -Deep Learning & Transformer Architectures USD 150K-200K

Attention Mechanisms | C++ | Decoder Only | Decoder-only Transformer | GPU parallelism

Comprehensive benefits

Senior-level Full Time

New York, New York, United States …

22d ago

Senior Quantization Engineer - Edge AI Model Optimization INR 3000K-5000K

C++ | CNN | Deep learning | Embedded Systems | Generative AI

Senior-level Full Time

Hyderabad, India

23d ago

Senior Staff Software Engineer, TPU Performance USD 262K-365K

Auto sharding | Benchmarking | C++ | Compiler optimization | Computer Engineering

Benefits | Bonus | Equity

Senior-level Full Time

Sunnyvale, CA, USA

25d ago

AI Inference Performance Engineer - New College Grad 2026 USD 124K-241K

Attention | Batching | C++ | CUDA | CUDA kernels

Benefits | Equity

Senior-level Full Time

US, CA, Santa Clara, United States

27d ago

Research Engineer - LLM/VLM Inference Optimization (Seed Infra) USD 244K-450K

CUDA | CUDA kernels | Compiler optimization | Graph Fusion | High Performance

Mid-level Full Time

San Jose, California, United States

30d ago

Senior Solutions Architect - Generative AI INR 2475K-4500K

Argo | CI/CD | CUDA | Evaluation | FedRAMP

Senior-level Full Time

India, Pune

1mo ago

Engineering Manager, Inference Benchmarking — AI Perf USD 224K-356K

DCGM | Distributed Systems | GPU Telemetry | GPU observability | Helm

Senior-level Full Time

US, CA, Santa Clara, United States

1mo ago

Tech Lead, Machine Learning Engineer - Global E-Commerce (Conversational AI) SGD 150K-191K

Data Curation | Deep learning | DeepSpeed | Direct Preference Optimization | Evaluation

Senior-level Full Time

Singapore, Singapore

1mo ago

Staff Machine Learning Engineer, ML Infrastructure USD 183K-269K

AWS EKS | Amazon IAM | Amazon S3 | Autoscaling | Batching

Employee resource groups | Free home security system | Free professional monitoring | Hybrid work model

Senior-level Full Time

Boston, MA

1mo ago

AI/ML ASIC Architect USD 163K-249K

ARM | ASIC | AXI | CUDA | CXL

Senior-level Full Time

Milpitas, CA, United States

1mo ago

AI/ML ASIC Architect USD 163K-249K

ARM | ASIC architecture | AXI interconnect | Area Optimization | Attention Mechanisms

Senior-level Full Time

Milpitas, CA, United States

1mo ago

AI Research Engineer (Model Compression & Quantization) - 100% Remote Worldwide USD 203K-330K

Compute Shaders | Diffusion Models | Distributed inference | Edge Computing | Expert parallelism

100 percent remote

Senior-level Full Time

Remote job R

1mo ago

AI Research Engineer (Kernel & Inference Optimization) USD 201K-332K

Computer Vision | Diffusion Models | Edge Computing | Expert parallelism | Flash Attention

Remote work

Senior-level Full Time

Remote job R

1mo ago

AI Research Engineer (Kernel & Inference Optimization) USD 201K-332K

Compute Shaders | Diffusion Models | Distributed inference | Edge Computing | Expert parallelism

English communication support | Remote work

Senior-level Full Time

Remote job R

1mo ago

AI Research Engineer (Kernel & Inference Optimization) - 100% Remote Worldwide USD 202K-325K

Diffusion Models | Distributed Inference Systems | Distributed inference | Expert parallelism | Flash Attention

100 percent remote | Worldwide remote

Senior-level Full Time

Remote job R

1mo ago

Staff Software Engineer, Machine Learning, Google Chat USD 207K-300K

Agentic Workflows | Caching | Cloud Spanner | Continuous Delivery | Continuous integration

Senior-level Full Time

Sunnyvale, CA, USA

1mo ago

AI Research Engineer (Kernel & Inference Optimization) USD 200K-332K

Compute Shaders | Diffusion Models | Distributed Inference Systems | Distributed inference | Edge Computing

Remote work

Senior-level Full Time

Remote job R

1mo ago

Senior Deep Learning Research Engineer, LLM Inference

Deep learning | Evaluation Pipelines | GPU Cluster | High Performance | High-Performance Computing

Senior-level Full Time

Israel, Tel Aviv

1mo ago

AI Platform Engineer INR 1500K-2500K

Automated Evaluation | CI/CD | CUDA | Continuous Checkpointing | Continuous batching

Mid-level Full Time

Bangalore, India

1mo ago

Software Engineering Manager, LLM Training USD 170K-277K

CUDA | Containerization | Context Parallelism | Data I/O | Data parallelism

Entry-level Full Time

Mountain View, CA, United States

1mo ago

AI Platform Engineer INR 1500K-2500K

Alerting | CUDA | Cause analysis | Continuous batching | GPU Profiling

Mid-level Full Time

Bangalore, India

1mo ago

LLM Inference Engineer USD 165K-250K

C++ | CUDA | Caching | Distributed Systems | GPU Optimization

Senior-level Full Time

Palo Alto

1mo ago

Machine Learning Engineer, Inference & Serving (Speech LLM) - San Francisco USD 180K-270K

AWQ | Audio codecs | Audio streaming | Autoscaling | Chunked prefill

401k matching | Annual offsites | Dental coverage | Employer-paid training | Healthcare benefits

Mid-level Full Time

San Francisco, CA

1mo ago

Senior Site Reliability Engineer, AI Inference EUR 67K-93K

AWS | Azure | C++ | CUDA | CUDA kernels

Senior-level Full Time

Dublin, Ireland

1mo ago

Principal Model Optimization Engineer USD 295K-345K

CUDA | Continuous batching | GPU | LLM Inference | Machine Learning

Senior-level Full Time

San Mateo, CA, United States R

1mo ago

Applied Scientist, GenAI USD 152K-189K

A/B | A/B Testing | AWS | Agent Orchestration | Agent systems

Senior-level Full Time

US - MA - Wilmington

1mo ago

Find jobs in AI/ML, Data Science and Big Data