97 jobs for LLM Inference

Backend Engineer, AI (Agent Systems) SEK 775K-1030K

Anthropic | Batching | Caching | Distributed Systems | Docker

Mid-level Full Time

Sweden

1d ago

Applied AI Engineer EUR 54K-75K

Agent Orchestration | Fine Tuning | Inference | JAX | LLM Inference

Senior-level Full Time

Germany

1d ago

AI Agent算法架构师 CNY 144K-240K

Agent Framework | Cloud Computing | Computer Vision | Edge AI | LLM Inference

Senior-level Full Time

深圳

3d ago

Machine Learning Infrastructure Engineer USD 100K-150K

API Gateway | Abuse detection | Automated rollback | Autoscaling | C++

Senior-level Full Time

United States - Remote R

3d ago

MLOps Engineer USD 100K-150K

API Gateway | Abuse detection | Automated rollback | Autoscaling | C++

Career growth | Remote work

Senior-level Full Time

United States - Remote R

3d ago

ML Performance Engineer USD 100K-150K

Attention Optimization | Benchmarking | C++ | Compiler optimization | Continuous batching

Mentorship | Remote work

Senior-level Full Time

Gilbert, AZ R

3d ago

Senior AI and Machine Learning Specialist

APIs | CI/CD | Computer Vision | Containerization | Context Management

Comprehensive benefits package | Health and family benefits

Senior-level Full Time

Israel, Yokneam

3d ago

Senior Director, Inference Products and Optimizations USD 274K-343K

AI workload | AI workload orchestration | AMD GPU | CUDA | Container Runtime

Conference reimbursement | Education reimbursement | Employee assistance program | Employee stock purchase program | Equity compensation

Senior-level Full Time

Seattle

4d ago

Senior Director, Inference Products and Optimizations USD 274K-343K

AI workload | AI workload orchestration | AMD | Benchmarking | Call Management

Employee assistance program | Flexible time off | LinkedIn Learning

Senior-level Full Time

San Francisco R

4d ago

ML Systems Engineer USD 100K-150K

API Gateway | Abuse detection | Automated rollback | Autoscaling | C++

Senior-level Full Time

United States - Remote R

4d ago

Senior Software Developer – Machine Learning Platform CAD 140K-170K

AWS | Agentic Workflows | Application design | Distributed Systems | Java

Senior-level Full Time

Montreal (Province of Quebec, Canada)

5d ago

AI Engineer EUR 60K-75K

APIs | Agentic coding | CI/CD | Context window | Data Pipelines

Mid-level Full Time

Maia, Porto District, Portugal

5d ago

Researcher - LLMs CAD 100K-168K

DDP | DeepSpeed | Diffusion Models | Distributed Training | FSDP

Senior-level Contract Full Time

Montreal, Quebec, Canada

5d ago

Senior ML Engineer, Doc Fraud GBP 70K-85K

AWS | Code review | Documentation | Evaluation Pipelines | GPU Optimization

Career growth | Collaborative culture | Hybrid work option | Learning opportunities | Remote work option

Senior-level Full Time

United Kingdom - London (Onfido)

5d ago

Senior Manager, AI Engineering (People Leader) (Gen AI Platform Services) USD 250K-286K

AWS | AWS Cloud | Artificial Intelligence | Azure | C#

Senior-level Full Time

San Jose, CA, United States

5d ago

Software Engineer - Compute Infrastructure (Orchestration & Scheduling) USD 148K-300K

AI | AI Inference | CPU | Containers | GPU

Senior-level Full Time

Seattle, Washington, United States

6d ago

Principal Engineer, AI Ecosystem USD 307K-428K

CUDA | Cloud Native | Cloud Orchestration | Deep learning | Distributed Systems

Senior-level Full Time

Sunnyvale, CA, USA; Kirkland, WA, USA

6d ago

Software Senior Engineer SGD 162K-225K

API Design | Agentic AI | Agile methodologies | Backend Development | Benchmarking

Senior-level Full Time

Singapore

6d ago

Principal AI Architect CAD 105K-130K

AI Security | AI native systems | AI-native | Accuracy evaluation | Adversarial Input

Senior-level Full Time

Ottawa, Canada

6d ago

Lead AI Engineer (AI Foundations, RecSys) USD 197K-245K

AWS | Azure | C# | C++ | Experimentation

Senior-level Full Time

San Jose, CA, United States

6d ago

Biometrics AI/ML Engineer USD 146K-191K

Agile | Benchmarking | Computer Vision | Data Pipelines | Deep learning

Educational assistance | Employee discounts | Flexible work hours | Generous vacation and holidays | Medical insurance

Senior-level Full Time

Oak Ridge, TN, US, 37830

6d ago

Principal AI Platform Engineer (US) USD 125K-200K

Authentication | Authorization | CI/CD | Container Security | Cost Optimization

Remote work

Senior-level Full Time

Remote, USA R

7d ago

Lead AI Engineer (MLX Emerging AI Patterns) USD 179K-245K

AWS | C# | C++ | Experimentation | Go

Senior-level Full Time

San Jose, CA, United States

7d ago

Finops Analytics - Assistant Vice President INR 4000K-5199K

API Integration | AWS | Agent systems | Anomaly Detection | Auditability

Executive-level Full Time

Chennai, Tamil Nadu, INDIA; Pune, Maharashtra, …

7d ago

Compiler Engineer, AI Inference- New College Grad 2026 USD 108K-195K

C# | C++ | Co-design | Compiler optimization | Computational Graph Optimization

None Full Time

US, CA, Santa Clara

7d ago

Applied AI Engineer USD 204K-352K

Backend Development | Cloud infrastructure | Deep learning | Docker | Fine Tuning

Annual membership | Centralized coffee stipend | Flexible PTO | Health and wellness stipend | Health, dental, and vision insurance

Senior-level Full Time

New York, NY (HQ)

8d ago

Senior Lead AI Engineer (MLX, Agentic AI, Gen AI platform Services) USD 229K-286K

C# | C++ | Deep learning | ETL | Go

Senior-level Full Time

McLean, VA, United States

8d ago

Software Engineer, AI Specialist - Wearables AI (Technical Leadership) USD 147K-208K

C plus plus | CI/CD | Cloud Computing | Computer Vision | Deep learning

Senior-level Full Time

Burlingame, CA

9d ago

Distinguished AI Engineer INR 3700K-5000K

AWS | Apache Spark | Azure | Cloud platform | Dask

Senior-level Full Time

Bangalore, In, India

10d ago

Lead AI Engineer (MLX, Agentic AI, Gen AI platform Services) USD 197K-245K

AWS | Azure | C# | C++ | Experimentation

Senior-level Full Time

San Jose, CA, United States

10d ago

Senior AI Engineer USD 121K-179K

Artificial Intelligence | Benchmarking | C# | C++ | CI/CD

Senior-level Full Time

Waterford, IE

10d ago

Staff Machine Learning Engineer USD 151K-309K

A/B | A/B Testing | B testing | Canary Deployment | Capacity Planning

Hybrid work

Senior-level Full Time

Remote, US R

11d ago

Senior Full-Stack Software Engineer, Applied AI USD 130K-140K

A/B | A/B Testing | AI Agents | AI Evaluation | B testing

Company retreats | Equity with refresh grants | Health benefits | Paid time off | Professional growth support

Senior-level Full Time

Remote R

11d ago

Sr Principal Software Development Engineer INR 2500K-5000K

Agent Orchestration | Bias Mitigation | Caching | Data Enrichment | Data Mapping

Senior-level Full Time

Pune, Maharashtra, India

12d ago

Principal Software Engineer, Machine Learning Infrastructure USD 235K-414K

Distributed Systems | GPU | High Throughput | High-Throughput Systems | Kubernetes

Comprehensive medical coverage | Emotional support | Equity RSUs | Mental health support | Paid parental leave

Senior-level Full Time

Palo Alto - 395 Page Mill …

12d ago

Senior AI Infrastructure Engineer, LLM/AI Platforms USD 140K-215K

AWS | Airflow | Amazon SageMaker | Ansible | Batching

Competitive vacation and holidays | Comprehensive wellness programs | Employee networks | Paid adoption leave | Paid parental leave

Senior-level Full Time

USA VA Remote, United States R

13d ago

Senior Manager, AI Engineering (People Leader) (Gen AI Platform Services) USD 229K-286K

AWS | Artificial Intelligence | C# | C++ | Experiment tracking

Senior-level Full Time

San Jose, CA, United States

13d ago

AI Researcher, On-Device LLM Efficiency USD 138K-208K

Attention Mechanisms | Deep learning | LLM Inference | LLM Reasoning | Model Optimization

Mid-level Full Time

San Diego, California, United States of …

13d ago

Senior Software Engineer I - AI Inference Data Plane INR 3584K-4400K

Continuous batching | Data parallelism | Databases | Distributed Systems | GPU Optimization

Conference reimbursement | Employee assistance program | Employee stock purchase program | Equity compensation | Flexible time off

Senior-level Full Time

Bengaluru

14d ago

Member of Technical Staff - RL Inference USD 180K-440K

C++ | CUDA | JAX | LLM Inference | Numerics

Senior-level Full Time

Palo Alto, CA

14d ago

Member of Technical Staff - Inference Research USD 150K-350K

Autoscaling | Disaggregated Prefill | FP8 | INT4) | KV cache

In-person collaboration

Senior-level Full Time

New York

15d ago

AI Intern USD 50K-80K

Bitbucket | Confluence | Flowcharts | Jira | LLM Inference

On-site work environment

Entry-level Internship

Carlsbad, CA, United States

17d ago

Developer Relations Manager, cuOpt and Graph Optimization CNY 360K-600K

API | Accelerated computing | Agentic AI | Artificial Intelligence | CUDA

Senior-level Full Time

China, Beijing

17d ago

Developer Relations Manager - Al Algorithms, Benchmarks, OSS Datasets CNY 300K-399K

AI for Science | APIs | Agentic AI | Artificial Intelligence | Benchmarks

Mid-level Full Time

China, Beijing

17d ago

Staff AI Platform & Agent Runtime Engineer CAD 120K-170K

AI Foundry | API Design | Agent Orchestration | Autogen | Azure

Senior-level Full Time

Toronto

18d ago

Senior Lead AI Engineer (MLX Emerging AI Patterns) USD 250K-286K

AWS | Azure | Deep learning | Google Cloud | Guardrails

Senior-level Full Time

San Jose, CA, United States

18d ago

Senior Lead AI Engineer (FM Hosting, LLM Inference) USD 229K-286K

AI Governance | AWS | C# | C++ | Experimentation

Senior-level Full Time

New York, NY, United States

18d ago

Infrastructure Platform Engineer INR 2500K-3500K

ArgoCD | Azure | Azure DevOps | Azure Key Vault | Azure Monitor

Senior-level Full Time

BANGALURU, KA, IN

18d ago

Sr. Distinguished AI Engineer (Remote Eligible) USD 286K-392K

AWS | Artificial Intelligence | C# | C++ | Foundation Model

Financial benefits | Health benefits | Incentive compensation | Remote eligible

Senior-level Full Time

San Francisco, CA, United States R

19d ago

大语言模型后训练算法工程师 CNY 240K-480K

Distributed Training | Docker | Evaluation metrics | Fine Tuning | Kubernetes

Mid-level Full Time

深圳、上海

19d ago

Find jobs in AI/ML, Data Science and Big Data