44 jobs for KV cache

AI Platform Engineer INR 1500K-2500K

Alerting | CUDA | Cause analysis | Continuous batching | GPU Profiling

Mid-level Full Time

Bangalore, India

21h ago

Tech Lead — ASR / TTS / Speech LLM (IC + Mentor) INR 2500K-4800K

Autoscaling | Batching | CTC | Caching | DER

Senior-level Full Time

Bengaluru

2d ago

Machine Learning Engineer, Inference & Serving (Speech LLM) - San Francisco USD 180K-270K

AWQ | Audio codecs | Audio streaming | Autoscaling | Chunked prefill

401k matching | Annual offsites | Dental coverage | Employer-paid training | Healthcare benefits

Mid-level Full Time

San Francisco, CA

4d ago

Forward Deployed Engineer (Inference & Post-Training) USD 270K-300K

DPO | GRPO | KV cache | LoRA | Pipeline parallelism

Equity | Health insurance | Remote work flexibility

Senior-level Full Time

San Francisco

4d ago

AI Architect Lead (Hybrid-within BankUnited's footprint) USD 130K-200K

AI Foundry | AWS | AWS Bedrock | Architecture Review | Architecture Review Board

Senior-level Full Time

Miami Lakes, FL, United States R

6d ago

Senior Data Scientist USD 200K-225K

AWS | Airflow | ArgoCD | Batching | CUDA

401k match | Dental insurance | FSA options | Flexible PTO | Free food

Senior-level Full Time

Marina del Rey, CA

6d ago

Senior Staff Engineer - AI Data Path USD 180K-287K

Automation | Benchmarking | C++ | CPU GPU | CPU GPU data movement

Senior-level Full Time

Remote, United States R

6d ago

Senior AI Engineer

Asyncio | Backpressure | Batching | Capacity Planning | Cost Control

Senior-level Full Time

Maslak, Sarıyer, Turkey

6d ago

Machine Learning Researcher -LLM Agents & Efficient Deep Learning CAD 106K-156K

ADaM | Agent systems | Context modeling | Function Calling | Gradient descent

Mid-level Full Time

Montreal, Quebec, Canada

7d ago

Distinguished Engineer, Machine Learning USD 147K-299K

Artificial Intelligence | Cache optimization | Inference Optimization | KV cache | KV cache optimization

Senior-level Full Time

Santa Clara, California, United States

7d ago

Principal Software Engineer - AI/ML (Ireland) EUR 58K-86K

C++ | CUDA | Cache Management | Cloud Native | Data-Driven Optimization

Senior-level Full Time

Remote Ireland R

8d ago

AI Engineer - Model Performance USD 165K-250K

Attention Backend | Audio Processing | Batching | CUDA | CUDA graph

Async communication | Innovation-focused culture | Remote work | Startup environment | Supportive team

Mid-level Full Time

SF Hybrid R

12d ago

Software Engineer, Inference AI/ML USD 92K-135K

Algorithms | C++ | CI/CD | CUDA | Caching

401k match | Company paid life insurance | Flexible PTO | Health savings account | Medical, dental, and vision insurance

Entry-level Full Time

Sunnyvale, CA / Bellevue, WA

13d ago

Research Scientist - AI Compute & DPU - Global Frontier Tech Recruitment Program - 2027 Start (PhD) USD 212K-387K

AI Agent | AI agent workflows | Agent workflows | CPU Scheduling | Cause analysis

None Full Time

San Jose, California, United States

13d ago

AI Software Engineer Intern CNY 38K-50K

CUDA | Distributed Systems | FP8 | FasterTransformer | Flash Attention

On-site work

Entry-level Full Time Internship

CHN - Minhang, China

13d ago

AI Software Engineer Intern CNY 38K-50K

CUDA | Compiler optimization | Continuous batching | Distributed Systems | Dynamic batching

On-site work

Entry-level Full Time Internship

CHN - Minhang, China

13d ago

AI Software Engineer Intern CNY 28K-50K

AWQ | Cache optimization | DINOv2 | DeepSpeed | Diffusion Models

Entry-level Full Time Internship

CHN - Minhang, China

13d ago

AI Software Engineer Intern CNY 38K-50K

ARM NEON | ARM SVE | AVX-512 | AVX2 | C#

On-site work

Entry-level Full Time Internship

CHN - Minhang, China

13d ago

Machine Learning Engineer 5 - Globalization USD 466K-750K

Batching | Data Pipelines | Distributed Training | GPU Optimization | Inference Optimization

401k matching | Disability coverage | Flexible spending account | Flexible time off | Health insurance

Senior-level Full Time

USA - Remote, United States R

13d ago

AI Software Engineer USD 151K-332K

C++ | CUDA | CUDA kernels | Continuous batching | FP8

Hybrid work | In-person work | Remote work | Work-life balance

Mid-level Full Time

Seattle (WA), United States

14d ago

Senior Machine Learning Engineer – Fine-Tuning and On-device AI USD 120K-215K

Agent systems | Attention Mechanism | CPU | Continuous Improvement | DPO

Dental insurance | Employee assistance program | Flexible Paid Vacation | Flexible paid sick leave | Flexible spending account

Senior-level Full Time

Palo Alto, CA

21d ago

Senior DL Software Engineer, Model Optimization and Edge Deployment - Autonomous Vehicles USD 184K-356K

C++ | CUDA | Cutlass | Efficient Attention | GPU Architecture

Senior-level Full Time

US, CA, Santa Clara, United States

21d ago

Sr. AI Inference Systems Engineer USD 120K-225K

CUDA | Distributed Systems | Hardware Accelerators | Inference Optimization | Instruction set

401k | Dental insurance | Disability insurance | Health insurance | Life insurance

Senior-level Full Time

US-California-Palo Alto, United States

22d ago

LLM Algorithm Engineer CNY 38K-50K

API Development | Agent systems | Attention Mechanisms | Autogen | CUDA

English courses | Meal allowance | Online learning access | Onsite gym | Onsite massages

Mid-level Full Time

Chang Sha Shi, China

23d ago

LLM Inference Performance & Evals Engineer CAD 142K-195K

Attention Mechanisms | C# | C++ | Compiler optimization | Debugging

Job stability | Open source collaboration | Research publications

Mid-level Full Time

Toronto, Ontario, Canada

26d ago

Staff Engineer - AI Development INR 2400K-3880K

Automation | Benchmarking | C plus plus | CPU GPU data movement | Cache Management

Senior-level Full Time

Pune, MH, India

27d ago

Senior Staff Engineer USD 156K-234K

C plus plus | C# | GPUDirect Storage | Infinia | Infiniband

Senior-level Full Time

Remote, United States R

28d ago

Senior Software Engineer - AI Inference USD 152K-287K

Batching | C++ | CUDA | Concurrency | Distributed Systems

Benefits | Equity

Senior-level Full Time

US, CA, Santa Clara, United States

28d ago

Senior Performance Analyst, Inference USD 175K-260K

Attention Mechanism | CUDA | Flash Attention | GPU kernel optimization | KV cache

Senior-level Full Time

Sunnyvale, CA

29d ago

AI Inference Engineer - Model Optimization & Deployment USD 205K-303K

Accuracy evaluation | BF16 | C++ | CUDA | CUDA kernels

Senior-level Full Time

Foster City, CA

1mo ago

Senior Software Engineer, AI Inference CAD 135K-220K

C++ | Chunked prefill | Continuous batching | Cutlass | Docker

Senior-level Full Time

Canada, Toronto

1mo ago

Senior Product Manager, AI Inference - Dynamo USD 208K-327K

Agentic AI | Artificial Intelligence | Cache Management | Data-driven | Data-driven project management

Senior-level Full Time

US, CA, Santa Clara, United States

1mo ago

Senior Solutions Architect - KV Cache and AI Storage CNY 460K-600K

Bluefield | CMX | Caching | Cassandra | Ceph

Senior-level Full Time

China, Beijing

1mo ago

Solutions Architect - Top AI Labs CNY 435K-500K

Artificial Intelligence | C++ | Computer Systems | Data Structures | Distributed Computing

Senior-level Full Time

China, Beijing

1mo ago

Deep Learning Solution Architect

Agentic Inference | CUDA | Distributed Training | Docker | GPU Computing

Senior-level Full Time

China, Beijing

1mo ago

Senior Deep Learning Solution Architect CNY 367K-490K

C++ | Caching | Computer Architecture | Data Structures | Data transfer

Senior-level Full Time

China, Beijing

1mo ago

Principal Machine Learning Engineer, Distributed vLLM Inference USD 189K-312K

API Gateway | C++ | Cilium | Distributed tracing | Envoy

Medical/Dental/Vision insurance | Paid parental leave | Paid time off | Retirement 401k match

Senior-level Full Time

Boston, United States R

1mo ago

Software Engineer, LLM Infrastructure A USD 150K-250K

Continuous batching | Jupyter | KV cache | Low Latency | Machine Learning

Daily meals | Housing subsidy | Medical, dental & vision coverage | Relocation support

Mid-level Full Time

Cupertino, CA

1mo ago

大模型算法部署优化工程师（上海-实习） CNY 25K-37K

C++ | Inference frameworks | KV cache | Linux | Model Quantization

Entry-level Internship

上海

1mo ago

Inference Software Engineer USD 150K-275K

C++ | CUDA | Continuous batching | Distributed Systems | KV cache

Daily meals | Housing subsidy | Medical, dental & vision coverage | Relocation support

Senior-level Full Time

Cupertino, CA

1mo ago

Machine Learning Research Engineer USD 150K-275K

CUDA | Deep learning | Distributed Training | Distributed inference | Inference Optimization

Daily meals | Housing subsidy | Medical, dental & vision coverage | Relocation support

Senior-level Full Time

Cupertino, CA

1mo ago

Senior Software Engineer II, Inference USD 165K-242K

Autoscaling | BF16 | C++ | CI/CD | CUDA

401k match | Employee stock purchase program | Flexible PTO | Flexible spending account | Health savings account

Senior-level Full Time

Sunnyvale, CA / Bellevue, WA

1mo ago

Senior Engineer 2: Inference Data Plane USD 167K-209K

AI | Databases | Distributed Systems | GPU Optimization | GRPC

Benefits support | Educational courses | Equity compensation | Flexible time off | Reimbursement for training

Senior-level Full Time

San Francisco R

1mo ago

Senior Engineer 2: Inference Data Plane USD 167K-209K

AI | Continuous batching | Data parallelism | Databases | Distributed Systems

Employee assistance program | Equity compensation | Flexible time off | Learning & development resources | Local Employee Meetups

Senior-level Full Time

Austin R

1mo ago

Find jobs in AI/ML, Data Science and Big Data