73 jobs for KV cache

AI Performance Optimization Engineer USD 100K-150K

Benchmarking | C++ | Continuous batching | Cutlass | DeepSpeed

Career growth potential | Full-time benefits | H1B transfer support for qualified candidates | Long-term engagement | Remote work

Mid-level Full Time

United States - Remote R

1d ago

AI Performance Optimization Engineer USD 100K-150K

Benchmarking | C++ | Compiler optimization | Continuous batching | Deep learning

Mid-level Full Time

United States - Remote R

1d ago

AI Performance Optimization Engineer USD 100K-150K

C++ | Communication Primitives | Continuous batching | Distributed Training | FSDP

Career growth | Health benefits | Mentorship | Remote work

Mid-level Full Time

United States - Remote R

1d ago

AI Performance Optimization Engineer USD 100K-150K

C++ | Continuous batching | Custom Kernel | Custom kernel development | Cutlass

100 percent remote | Benefits package | Full-time employment

Mid-level Full Time

United States - Remote R

4d ago

AI Performance Optimization Engineer USD 100K-150K

Benchmarking | C++ | Continuous batching | Data loading | Data loading optimization

Mid-level Full Time

United States - Remote R

4d ago

AI Performance Optimization Engineer USD 100K-150K

C++ | CUDA | Continuous batching | Cutlass | DeepSpeed

Mid-level Full Time

United States - Remote R

4d ago

Engineering Manager, Inference Benchmarking — AI Perf USD 224K-356K

DCGM | Distributed Systems | GPU Telemetry | GPU observability | Helm

Senior-level Full Time

US, CA, Santa Clara, United States

5d ago

AI Performance Optimization Engineer USD 100K-150K

Benchmarking | C++ | CUDA | Continuous batching | Cutlass

Benefits package | Remote work

Mid-level Full Time

United States - Remote R

5d ago

AI Performance Optimization Engineer USD 100K-150K

Benchmarking | C++ | Compiler optimization | Continuous batching | Cutlass

Career growth | Health benefits | Mentorship | Remote work

Mid-level Full Time

United States - Remote R

5d ago

Product Manager - AI Inference & Model Serving USD 165K-275K

AI Inference | Artificial Intelligence | Autoscaling | Cache Management | Continuous batching

Conference attendance | Professional development | Stock options | Training | Workstation provided

Mid-level Full Time

Austin, TX, United States

6d ago

AI Software Engineer USD 151K-332K

C++ | CUDA | Continuous batching | FP16 | FP8

Hybrid work | Remote work

Mid-level Full Time

Seattle (WA), United States

6d ago

Tech Lead, Machine Learning Engineer - Global E-Commerce (Conversational AI) SGD 150K-191K

Data Curation | Deep learning | DeepSpeed | Direct Preference Optimization | Evaluation

Senior-level Full Time

Singapore, Singapore

8d ago

Senior ML Engineer - Kimchi (LLM Inference Optimization GBP 110K-141K

Activations quantization | Amazon Web Services | ArgoCD | CUDA | CUDA-adjacent tooling

Equipment budget | Equity options | Extra days off | Hackathon | Learning budget

Senior-level Full Time

United Kingdom R

8d ago

Senior ML Engineer - Kimchi (LLM Inference Optimization) PLN 292K-400K

AWS | ArgoCD | Azure | CUDA | Chunked prefill

Annual hackathon | Conference access | Equipment budget | Equity options | Extra days off

Senior-level Full Time

Poland R

8d ago

Senior ML Engineer - Kimchi (LLM Inference Optimization) EUR 78K-108K

AWS | Argo CD | ArgoCD | Azure | CUDA

Conference access | Equipment budget | Equity options | Extra days off | Flexible work hours

Senior-level Full Time

France R

8d ago

Senior MLOps Engineer - LLMs EUR 56K-76K

A/B | A/B Testing | Argo | Async API | Authentication

Autonomy | Hybrid work model | Professional growth and learning

Senior-level Full Time

Netherlands - Amsterdam

11d ago

Staff Machine Learning Engineer, ML Infrastructure USD 183K-269K

AWS EKS | Amazon IAM | Amazon S3 | Autoscaling | Batching

Employee resource groups | Free home security system | Free professional monitoring | Hybrid work model

Senior-level Full Time

Boston, MA

12d ago

AI/ML ASIC Architect USD 163K-249K

ARM | ASIC | AXI | CUDA | CXL

Senior-level Full Time

Milpitas, CA, United States

12d ago

AI/ML ASIC Architect USD 163K-249K

ARM | ASIC architecture | AXI interconnect | Area Optimization | Attention Mechanisms

Senior-level Full Time

Milpitas, CA, United States

12d ago

Machine Learning Engineer, Distributed vLLM USD 136K-287K

API Gateway | Cilium | Distributed Systems | Envoy | GPU Profiling

Paid parental leave | Paid time off | Retirement 401k match | Tuition reimbursement

Mid-level Full Time

Boston, United States R

12d ago

Product Manager - AI Inference & Model Serving USD 160K-275K

AI Inference | Autoscaling | Cache Management | Cold Start | Cold Start Optimization

Conference attendance | Professional development and training | Stock options | Workstation provided

Mid-level Full Time

Austin, TX, United States

13d ago

Associate Director, Software Engineering (Model Hosting/Inference Optimisation) CNY 240K-360K

AWQ | AWS | Accelerate | Azure | Batching

Mid-level Full Time

Shenzhen, Guangdong, China R

13d ago

Sr GenAI Infra Specialist SA, AWS WWSO Startup USD 153K-228K

AWS | Amazon EC2 | Amazon EKS | Amazon S3 | Cache optimization

Inclusive team culture | Mentorship and career growth | Work-life balance

Senior-level Full Time

New York, New York, USA

13d ago

AI Research Engineer (Model Compression & Quantization) - 100% Remote Worldwide USD 203K-330K

Compute Shaders | Diffusion Models | Distributed inference | Edge Computing | Expert parallelism

100 percent remote

Senior-level Full Time

Remote job R

14d ago

AI Research Engineer (Kernel & Inference Optimization) USD 201K-332K

Computer Vision | Diffusion Models | Edge Computing | Expert parallelism | Flash Attention

Remote work

Senior-level Full Time

Remote job R

14d ago

AI Research Engineer (Kernel & Inference Optimization) USD 201K-332K

Compute Shaders | Diffusion Models | Distributed inference | Edge Computing | Expert parallelism

English communication support | Remote work

Senior-level Full Time

Remote job R

14d ago

AI Research Engineer (Kernel & Inference Optimization) USD 201K-332K

Diffusion Models | Distributed Inference Systems | Distributed inference | Edge Computing | Expert parallelism

Remote work

Senior-level Full Time

Remote job R

14d ago

AI Research Engineer (Kernel & Inference Optimization) - 100% Remote Worldwide USD 202K-325K

Diffusion Models | Distributed Inference Systems | Distributed inference | Expert parallelism | Flash Attention

100 percent remote | Worldwide remote

Senior-level Full Time

Remote job R

14d ago

Staff Engineer USD 191K-239K

AMD GPU | Apache Yunikorn | Autoscaling | Bin packing | CRIU

Conference reimbursement | Education reimbursement | Employee assistance program | Employee stock purchase program | Equity compensation

Senior-level Full Time

Seattle

15d ago

Senior Applied ML Engineer (Speech & Audio) USD 140K-200K

Activity Detection | Audio codecs | Audio preprocessing | Automatic Speech Recognition | Conformer

Accommodation allowance | Career Development Programs | Career growth opportunities | Coffee | Daily Drinks

Senior-level Full Time

Egypt - Remote R

15d ago

Senior Applied ML Engineer (Speech & Audio) USD 140K-200K

Activity Detection | Audio Processing | Audio codecs | Automatic Speech Recognition | CUDA

Accommodation allowance | Career growth opportunities | Coffee and hot drinks | Company events and parties | Daily breakfast

Senior-level Full Time

Cairo, Cairo Governorate, Egypt

15d ago

Inference Engineer - Acceleration CHF 110K-160K

Admission control | CUDA | Cutlass | FlashAttention | KV cache

Commuting subsidy | Learning and development budget | Offsites and team events | Pension plan | Vacation days

Mid-level Full Time

Zürich, Switzerland

15d ago

AI SW Stack Deployment Architect INR 2500K-4500K

API Design | Cloud Computing | Distributed Systems | Edge Computing | Inference Server

Senior-level Full Time

Bengaluru, KA, India

15d ago

AI Research Engineer (Kernel & Inference Optimization) USD 200K-332K

Compute Shaders | Diffusion Models | Distributed Inference Systems | Distributed inference | Edge Computing

Remote work

Senior-level Full Time

Remote job R

16d ago

AI Research Engineer (Kernel & Inference Optimization) USD 200K-332K

Computer Vision | Deep learning | Diffusion Models | Distributed inference | Edge Computing

Remote work

Senior-level Full Time

Remote job R

16d ago

AI Research Engineer (Kernel & Inference Optimization) USD 200K-332K

Compute Shaders | Diffusion Models | Distributed Inference Systems | Distributed inference | Edge Computing

Remote work

Senior-level Full Time

Remote job R

16d ago

AI Research Engineer (Kernel & Inference Optimization) USD 200K-332K

Diffusion Models | Distributed Inference Systems | Distributed inference | Edge Computing | Expert parallelism

Career growth | Collaborative research environment | English communication support | Remote work opportunity

Senior-level Full Time

Remote job R

16d ago

AI Research Engineer (Kernel & Inference Optimization) USD 200K-332K

Compute Shaders | Custom Compute Shaders | Data Pipelines | Diffusion Models | Distributed Inference Systems

Remote work

Senior-level Full Time

Remote job R

16d ago

Engineer, Staff-AI and Machine Learning with embedded/C++ INR 2000K-3500K

C# | C++ | CUDA | Cross-Attention | Design Patterns

Senior-level Full Time

Hyderabad, Telangana, India

16d ago

Senior/Staff AI Engineer USD 150K-250K

CPU | Distributed Systems | GPU | Inference | KV cache

Senior-level Full Time

San Francisco - Remote, CA, United … R

18d ago

Lead AI Engineer / Architect (m/w/d) - Agentic Systems EUR 47K-47K

API Integration | Agent systems | Benchmarking | Computer Vision | Data Drift

Bare Metal GPU Cluster Access | Company bike leasing | Company events | Employer Subsidy | Flexible work hours

Senior-level Full Time

Heidelberg

20d ago

AI Platform Engineer INR 1500K-2500K

Automated Evaluation | CI/CD | CUDA | Continuous Checkpointing | Continuous batching

Mid-level Full Time

Bangalore, India

20d ago

Director Engineering - AI software stack INR 2400K-5199K

AI/ML | Agentic AI | Batching | CPU GPU | CPU GPU DSP NPU

Executive-level Full Time

Bangalore, Karnataka, India

20d ago

Senior Staff/Staff/Lead/Senior Engineer/Engineer -AI and Embedded, C++, AI, Machine Learning INR 1800K-3200K

Algorithm Optimization | C# | C++ | CPU | Cross-Attention

Senior-level Full Time

Hyderabad, Telangana, India

20d ago

Engineer, Staff-Machine Learning-Embedded and C++ INR 2000K-3500K

C# | C++ | CUDA | Cross-Attention | Design Patterns

Senior-level Full Time

Hyderabad, Telangana, India

20d ago

AI Platform Engineer INR 1500K-2500K

Alerting | CUDA | Cause analysis | Continuous batching | GPU Profiling

Mid-level Full Time

Bangalore, India

21d ago

Engineer, Senior-Machine Learning-Embedded,C++ INR 2000K-3500K

C# | C++ | CUDA | Cross-Attention | Design Patterns

Senior-level Full Time

Hyderabad, Telangana, India

21d ago

Engineer, Senior-AI and Machine Learning with embedded/C++ INR 2000K-3500K

C# | C++ | CUDA | Cross-Attention | Design Patterns

Senior-level Full Time

Hyderabad, Telangana, India

21d ago

Tech Lead — ASR / TTS / Speech LLM (IC + Mentor) INR 2500K-4800K

Autoscaling | Batching | CTC | Caching | DER

Senior-level Full Time

Bengaluru

23d ago

Machine Learning Engineer, Inference & Serving (Speech LLM) - San Francisco USD 180K-270K

AWQ | Audio codecs | Audio streaming | Autoscaling | Chunked prefill

401k matching | Annual offsites | Dental coverage | Employer-paid training | Healthcare benefits

Mid-level Full Time

San Francisco, CA

25d ago

Find jobs in AI/ML, Data Science and Big Data