116 jobs for KV cache

Senior LLM Engineer USD 195K-255K

AI Foundry | AI Search | Azure AI | Azure AI Foundry | Azure AI Search

Senior-level Full Time

Austin, Texas | Fremont, California | …

1d ago

AI/ML ASIC Architect INR 3000K-6000K

ARM | ASIC | AXI interconnect | Attention Mechanisms | CUDA

Senior-level Full Time

Bengaluru, KA, India

1d ago

AI/ML ASIC Architect INR 3000K-6000K

ARM | ASIC | AXI | Attention Mechanism | CUDA

Senior-level Full Time

Bengaluru, KA, India

1d ago

AI Architect Lead (Hybrid-within BankUnited's footprint) USD 148K-205K

AI Foundry | AWS | AWS Bedrock | Artificial Intelligence | Autogen

Senior-level Full Time

Miami Lakes, FL, United States

1d ago

Senior LLM Engineer USD 195K-255K

AI Foundry | AI Search | Azure AI | Azure AI Foundry | Azure AI Search

Senior-level Full Time

Austin, Texas | Fremont, California | …

2d ago

Senior Software Engineer, Generative AI, Gaming INR 2500K-5000K

3D mathematics | C++ | Computer Graphics | Computer Vision | Data Processing

Senior-level Full Time

Bengaluru, Karnataka, India

2d ago

ML Platform Engineer USD 100K-160K

API Gateway | Abuse detection | Automated rollback | Autoscaling | C++

Remote work

Senior-level Full Time

Shrewsbury, MA R

2d ago

Software Engineer, Inference (AI Data Engineering) USD 135K-175K

Auto Scaling | Batch scheduling | C plus plus | CI/CD | ClickHouse

401k | Dental insurance | Life insurance | Long-term disability insurance | Medical insurance

Entry-level Full Time

Palo Alto, CA R

3d ago

Tech Lead, Machine Learning Engineer - Global E-Commerce (Conversational AI) SGD 150K-199K

AI Feedback | Agent systems | Context engineering | Deep learning | DeepSpeed

Senior-level Full Time

Singapore, Singapore

3d ago

LLM System Backend Engineer Graduate (AML Ark) - 2027 Start SGD 60K-60K

C++ | CUDA | Collective communication | Disaggregated inference | Distributed KV Cache

Entry-level Full Time

Singapore, Singapore

3d ago

Research Engineer / Scientist - Storage for LLM USD 162K-387K

Batching | C++ | CUDA | CUDA Networking | CUDA aware Networking

401k match | Conference attendance | Life insurance | Long-term disability | Medical/Dental/Vision insurance

Mid-level Full Time

San Jose, California, United States R

3d ago

Senior Research Engineer / Scientist - Storage for LLM USD 207K-368K

Autoregressive decoding | Batched decoding | C++ | CUDA | CUDA aware Networking

401k savings plan with company match | Conference attendance | Life insurance | Long-term disability | Medical/Dental/Vision insurance

Senior-level Full Time

Seattle, Washington, United States R

3d ago

Machine Learning Engineer Graduate (AML-Engine-Orchestration) - 2027 Start USD 128K-256K

Algorithms | Autoscaling | C++ | Concurrent programming | Containerization

401k match | Life insurance | Long-Term Disability coverage | Medical/Dental/Vision insurance | Paid Holidays

Entry-level Full Time

San Jose, California, United States

3d ago

Large Language Model Inference System Engineer Graduate (Applied Machine Learning) - 2027 Start USD 128K-256K

C++ | CUDA | Distributed Systems | GPU | High Performance

401k match | Dental insurance | Life insurance | Long-term disability | Medical insurance

Entry-level Full Time

San Jose, California, United States

3d ago

Research Engineer / Scientist - Storage for LLM USD 153K-300K

Batching | C++ | CUDA | CUDA Networking | CUDA aware Networking

401k matching | Life insurance | Long-term disability | Medical, dental, and vision insurance | Paid Holidays

Mid-level Full Time

Seattle, Washington, United States R

3d ago

Machine Learning Engineer Intern (AML-Engine-Orchestration) - 2027 Start USD 86K-86K

Autoscaling | C++ | Concurrent programming | Disaster Recovery | Distributed Systems

Development workshops | Health insurance | Housing allowance | Learning programs | Life insurance

Entry-level Internship

Seattle, Washington, United States

3d ago

MLOps Engineer USD 100K-150K

API Gateway | Abuse detection | Automated rollback | Autoscaling | C++

Senior-level Full Time

United States - Remote R

3d ago

[AI Research Div.] ML Serving Engineer (5년 이상) KRW 31000K-31000K

Alerting | CI/CD | CUDA | Dynamic batching | GPU

Senior-level Full Time

Seoul

4d ago

Staff AI Engineer USD 151K-332K

C++ | CUDA | CUDA kernel | CUDA kernel development | Cache Management

Hybrid work | In-person work | Remote work | Work-life balance support

Senior-level Full Time

Seattle (WA), United States R

4d ago

Principal Product Manager, AI Infrastructure and Orchestration USD 187K-240K

API Design | API Versioning | API server | Accelerators | Access Control

Flexible time off program | Global employee assistance program | Medical, dental, and vision insurance | Paid Holidays | Paid parental leave

Senior-level Full Time

Remote WA, United States R

4d ago

Chief Leading Expert - Next-Gen Storage Media & AI Data Infrastructure CHF 128K-192K

Caching | Cold storage | Data Classification | Data Tiering | Data computing

Senior-level Full Time

Zürich, Switzerland

5d ago

ML Systems Engineer — Inference Acceleration EUR 80K-150K

Benchmarking | C++ | CUDA | Communication and Computation Overlap | Compiler optimization

Healthcare coverage | Paid time off | Pension contributions | Professional development support | Stock options

Mid-level Full Time

Paris Offices

5d ago

Senior Inference Engineer, AGI USD 168K-261K

Attention | Autoregressive decoding | CUDA | CUDA kernels | Continuous batching

401k matching | Dental insurance | Health insurance | Mental health support | Paid time off

Senior-level Full Time

Sunnyvale, California, USA

5d ago

Inference Systems Performance Architect USD 245K-325K

Benchmarking | Bottleneck analysis | Capacity Planning | Continuous batching | Distributed Systems

Counseling services | Dental insurance | Employee assistance program | Gym membership | Health insurance

Senior-level Full Time

San Jose, California, United States

6d ago

Software Engineer, AI Kernels & Performance Optimization — MTIA Software USD 175K-255K

Attention kernels | C++ | CUBLAS | CUDA | CUDNN

Senior-level Full Time

Bellevue, WA | Menlo Park, CA …

8d ago

Software Engineer — Distributed LLM Inference Systems CNY 60K-60K

Asynchronous Communication | C plus plus | Continuous batching | Data parallelism | Deep learning

On-site work

Entry-level Full Time

CHN - Minhang, China

8d ago

Senior Inference Optimization Engineer - Dragonfly Portfolio USD 152K-239K

ASICs | C++ | CUDA | CUDA Graphs | Continuous batching

Remote work

Senior-level Full Time

United States (Remote) R

8d ago

Software Engineer, Model Inference, DeepMind USD 207K-300K

CUDA | Caching | Distributed Systems | GPUs | Hardware acceleration

Senior-level Full Time

London, UK; Mountain View, CA, USA

9d ago

Senior Product Manager – AI Inference Performance USD 208K-327K

Artificial Intelligence | Benchmarking | Inference Optimization | Inference Server | KV cache

Senior-level Full Time

US, CA, Santa Clara

9d ago

Senior System Software Engineer - Local AI INR 2500K-4800K

Algorithms | C++ | CUDA | DXGKC | Data Structures

Senior-level Full Time

India, Pune

9d ago

AI/Machine Learning Researcher, Staff (AI Research) USD 179K-268K

Agentic AI | Artificial Intelligence | Attention Mechanisms | Cache Compression | Edge Computing

Career development | Inclusive work environment

Senior-level Full Time

San Diego, California, United States of …

9d ago

AI Infra Engineer Graduate (Recommendation & LLM) - 2027 Start USD 128K-300K

Algorithms | C++ | CUDA | Computer Systems | Continuous batching

Career development

Entry-level Full Time

San Jose, California, United States

10d ago

AI Infra Engineer Graduate (Recommendation & LLM) 2027 Start (PhD) USD 148K-300K

Algorithms | C++ | CUDA | Computer Systems | Continuous batching

Entry-level Full Time

San Jose, California, United States

10d ago

Software Engineer, Applied AI Infrastructure USD 193K-352K

Attention | Batching | CI Failure Attribution | Cloud infrastructure | Context handling

Senior-level Full Time

Mountain View, California (HQ)

10d ago

Principal Software Engineer - LLM Optimization USD 176K-215K

AWQ | AWS | Amazon EKS | Asynchronous execution | CUDA

Backup childcare | Financial coaching | Health care coverage | Mental health support | On-site health and wellness centers

Senior-level Full Time

Jersey City, NJ, United States

11d ago

Staff Software Engineer AI/ML USD 163K-253K

A/B | A/B Testing | Autogen | B testing | Batched Inference

401k | Adoption support | Charitable giving match | Fertility care stipend | Flexible work environment

Senior-level Full Time

San Jose, California, United States

11d ago

Senior Machine Learning Engineer USD 188K-282K

AB Testing | Adversarial Machine Learning | Calibration monitoring | Canary Releases | Closed Loop

Senior-level Full Time

Palo Alto, CA

11d ago

AI Researcher USD 295K-445K

Cache Compression | Deep learning | Direct Preference Optimization | Experiment design | Fine Tuning

Fast Hiring Response | Immigration support | In person Work Mode | Permission to Publish | Relocation support

Senior-level Full Time

San Francisco Office

12d ago

Performance Engineer, Inference INR 4000K-6000K

C++ | CUDA | Copy-on-write | Disaggregated Prefill | Disaggregated prefill decode

Senior-level Full Time

Bengaluru R

12d ago

Staff Machine Learning Engineer – Model Optimization & Quantization USD 160K-240K

4 bit Quantization | Accuracy evaluation | Activation Quantization | C++ | Git

Senior-level Full Time

Santa Clara, California, United States of …

12d ago

Technical Product Manager, AI Inference & Software USD 200K-350K

Agentic AI | Attention | Automation | Batching | Benchmarking

13 Paid Company Holidays | 401K company matching | Company paid life and disability coverage | Company provided computer and home office setup | Fully company paid medical dental and vision

Senior-level Full Time

Remote (United States) R

14d ago

Staff Software Engineer, Inference GBP 116K-155K

Autoscaling | BF16 | Benchmarking | C++ | CUDA

Critical illness cover | Employee assistance programme | Family dental insurance | Family medical insurance | Life assurance

Senior-level Full Time

London, England

15d ago

Recommendation Architecture AI/ML Infrastructure Engineer Intern (Data-Arch-TikTok Live) - 2027 Summer USD 119K-177K

Algorithms | C++ | CUDA | Computer Systems | Continuous batching

Development workshops | Hands-on industry experience | Learning programs | Social events

Entry-level Internship

San Jose, California, United States

15d ago

Recommendation Architecture AI/ML Infrastructure Engineer Graduate (Data-Arch-TikTok Live) - 2027 Start USD 116K-177K

Algorithms | C++ | CUDA | Computer Systems | Continuous batching

Entry-level Full Time

San Jose, California, United States

15d ago

System Software Engineer - Local AI INR 2000K-4408K

Algorithms | C++ | CUDA | Data Structures | Deep learning

Mid-level Full Time

India, Pune

16d ago

Inference Performance Engineer, AI Inference Configuration Optimization USD 124K-195K

C++ | CUDA | CUPTI | Continuous batching | KV cache

Senior-level Full Time

US, CA, Santa Clara R

16d ago

Senior Software Architect, AI Networking ILS 420K-504K

C++ | CUDA | Cluster scheduling | Compute scheduling | Deep learning

Senior-level Full Time

Israel, Tel Aviv

17d ago

Principal Software Engineer – Large-Scale LLM Memory and Storage Systems USD 272K-431K

C# | C++ | Caching | Distributed Systems | GPU Architecture

Comprehensive benefits | Equity

Senior-level Full Time

US, CA, Santa Clara R

17d ago

Senior Inference Technical Product Marketing Manager - Accelerated Computing USD 148K-235K

Accelerated computing | CUDA | Competitive Analysis | Data center | Data center architecture

Senior-level Full Time

US, CA, Santa Clara

17d ago

Software Engineer, GPU Inference CAD 135K-220K

Asynchronous execution | BF16 | Benchmarking automation | Benchmarks | C++

Senior-level Full Time

US and Canada Offices

17d ago

Find jobs in AI/ML, Data Science and Big Data