96 jobs for LLM Inference

Senior Principal Software Engineer, Machine Learning USD 222K-453K

A/B | A/B Testing | B testing | Canary Deployment | Capacity Planning

Hybrid work model | Mentorship

Senior-level Full Time

Remote, US R

2d ago

Machine Learning Engineer Graduate (Agent Evaluation & Evolution) - 2027 Start USD 128K-256K

Automated testing | Benchmarking | Data Pipelines | Human Feedback | LLM Inference

Entry-level Full Time

San Jose, California, United States

2d ago

Senior Artificial Intelligence/Machine Learning Engineer UAH 1377K-1549K

Asynchronous programming | Benchmarking | Docker | Evaluation Frameworks | Fine Tuning

Company-paid certifications | Conferences | Financial consultations | Language courses | Legal consultations

Senior-level Full Time

Ukraine R

2d ago

Lead Machine Learning Engineer USD 144K-248K

AWS | Agentic AI | Amazon Athena | CI/CD | Docker

401k matching | Bereavement leave | Dental insurance | Fitness and wellness stipend | Jury duty leave

Senior-level Full Time

New York R

2d ago

ML Platform Engineer USD 100K-160K

API Gateway | Abuse detection | Autoscaling | C++ | Caching

Senior-level Full Time

Lexington, MA R

4d ago

MLOps Engineer USD 100K-150K

API Gateway | Abuse detection | Automated rollback | Autoscaling | C++

Career growth potential | Remote work

Senior-level Full Time

United States - Remote R

4d ago

Principal AI Architect USD 195K-300K

AI Inference | AI orchestration | AIOps | BGP | Cilium

Employee resource groups | Flexible work options | Generous PTO | Hackathons | Health coverage

Senior-level Full Time

United States

4d ago

Senior Software Engineer, GenAI Platform GBP 75K-90K

APIs | AWS | Autoscaling | Batch inference | Cost Optimization

Senior-level Full Time

London - The River Building HQ

4d ago

AI Computing Software Development Engineer, TensorRT-LLM TWD 1900K-2300K

C# | C++ | CPU architecture | CUDA | Debugging

Senior-level Full Time

Taiwan, Taipei

4d ago

Senior Deep Learning Algorithm Engineer USD 180K-287K

Algorithms | C++ | CUDA | Computer Architecture | Deep learning

Senior-level Full Time

Vietnam, Ho Chi Minh City R

4d ago

Senior Software Engineer, Machine Learning Inference USD 152K-241K

C++ | CUDA | Compilers | Deep learning | GPU Programming

Senior-level Full Time

US, CA, Santa Clara

5d ago

Engineering Manager, LLM Performance USD 224K-356K

APIs | C++ | CUDA | GPU Architecture | LLM Inference

Mid-level Full Time

US, CA, Santa Clara

5d ago

Systems Engineer - Data and Insights USD 140K-206K

AI | Cause analysis | Data Governance | Data Modeling | Data Pipelines

Hybrid work arrangement | Relocation assistance

Mid-level Full Time

GM Global Technical Center - Michigan …

5d ago

Technical Support Engineer (Inference) - US Weekends USD 160K-230K

AWS | Ansible | Azure | Capacity scaling | Container Infrastructure

Health insurance | Remote work flexibility | Startup equity | Weekend and holiday coverage schedule

Senior-level Full Time

Remote R

5d ago

Senior Software Developer – Machine Learning Platform CAD 140K-170K

AWS | Application design | Debugging | Distributed Systems | Java

Senior-level Full Time

Montreal (Province of Quebec, Canada)

5d ago

Senior Machine Learning Engineer, Jockey Core

Autoscaling | Batching | Capacity Planning | Disaggregated Prefill | Disaggregated prefill decode

Conference allowance | English education program | Equipment stipend | Flu vaccination support | Global buddy program

Senior-level Full Time

Seoul, South Korea

5d ago

Edge Computing AI Engineer USD 100K-105K

C++ | DSP | Edge inference | Embedded Systems | Federated Learning

Career growth | Remote work

Mid-level Full Time

United States - Remote R

6d ago

Distinguished AI Engineer INR 3700K-5449K

AWS | Apache Spark | Azure | Cloud platform | Dask

Senior-level Full Time

Bangalore, In, India

6d ago

Senior Manager, AI Engineering (People Leader) (Gen AI Platform Services) USD 229K-262K

AI Governance | AWS | Artificial Intelligence | C# | C++

Senior-level Full Time

San Jose, CA, United States

6d ago

GenAI & AI/ML Framework Specialist USD 85K-105K

AWS SageMaker | Azure AI | CUDA | ChromaDB | Cloud Platforms

Company-Paid Holidays | Employee assistance programs | Life and disability insurance | Medical, dental, and vision coverage | Paid time off

Senior-level Full Time

New York, NY, US

6d ago

Staff Software Engineer, Inference GBP 325K-390K

AWS | Autoscaling | Azure | Batching | Caching

Competitive benefits | Equity donation matching | Flexible working hours | Generous vacation | Hybrid work policy

Senior-level Full Time

London, UK

6d ago

AI Field Engineer, AI infrastructure (Remote - US) A USD 220K-280K

AWS | Azure | Cloud platform | Direct Preference Optimization | Fine Tuning

Comprehensive benefits package | Remote work | Travel to enterprise customers | Visa sponsorship possible

Mid-level Full Time

San Mateo R

6d ago

AI Infrastructure Engineer Graduate (TikTok Recommendation Architecture) - 2027 Start SGD 60K-65K

Algorithms | C++ | CUDA | Computer Systems | Continuous batching

Entry-level Full Time

Singapore

6d ago

ML Engineer (Intelligence) - Bengaluru INR 3000K-5000K

Benchmarking | Embeddings | Fine Tuning | LLM Inference | Language Models

Senior-level Full Time

Bengaluru, Karnātaka, India

6d ago

Senior Deep Learning Researcher, LLM Inference

Algorithm Optimization | Deep learning | GPU Computing | HPC | High Performance

Senior-level Full Time

Israel, Tel Aviv

7d ago

Senior Lead AI Engineer (FM Hosting, LLM Inference) USD 229K-262K

AI Governance | AWS | Azure | C# | C++

Health benefits | Incentive compensation | Inclusive work environment | Relocation assistance

Senior-level Full Time

McLean, VA, United States

7d ago

Lead AI Engineer USD 197K-225K

AI Governance | AWS | Azure | C# | C++

Health benefits

Senior-level Full Time

McLean, VA, United States

7d ago

Senior Performance Co-Design Engineer, LLM Serving USD 174K-252K

C++ | Co-design | Computer Architecture | Deep learning | Deep learning inference

Senior-level Full Time

Sunnyvale, CA, USA

9d ago

Director of AI Engineering USD 195K-260K

A/B | A/B Testing | API Design | AWS | Agent Orchestration

401k match | Annual company retreats | Medical, dental, vision benefits | Paid time off | Promote from within

Executive-level Full Time

United States - Remote R

10d ago

AI Engineer Sr USD 95K-169K

APIs | AWS | Agent systems | Anthropic SDK | Azure

401k plan | Dental insurance | Employee stock purchase plan | Life insurance | Medical insurance

Senior-level Full Time

United States R

10d ago

Machine Learning/Operations Research Engineer USD 143K-264K

Agent workflows | AnyLogic | Apache Airflow | Arena | CP-SAT

Entry-level Full Time

Cupertino

11d ago

Staff AI Engineer - Enterprise Architecture USD 123K-215K

AWS | CrewAI | Data Validation | Embeddings | Evaluation

Senior-level Full Time

Phoenix, AZ, United States

11d ago

AI Engineer, Platforms SGD 60K-108K

AI Agent | AI agent orchestration | Agent Orchestration | Autoscaling | Bash

Mid-level Full Time

NTU Main Campus, Singapore

12d ago

Senior Lead AI Engineer (MLXT) USD 229K-262K

AWS | Automl | Azure | C# | C++

Senior-level Full Time

McLean, VA, United States

12d ago

Director, AI Engineering USD 293K-335K

AI orchestration | AWS | Agentic Workflows | Artificial Intelligence | C#

Executive-level Full Time

San Jose, CA, United States

12d ago

Machine Learning Engineer - AI Search (ByteDance Singapore) SGD 108K-170K

Agent systems | Fine Tuning | Inference Optimization | Knowledge representation | LLM Inference

Senior-level Full Time

Singapore, Singapore

12d ago

Software Engineer Graduate (Inference Infrastructure) - 2026 Start (PhD) USD 156K-316K

Cloud Native | Containerization | Distributed Systems | GPU Acceleration | Kubernetes

Career growth | Collaborative engineering environment | Global opportunities | Open Source contribution

Entry-level Full Time

San Jose, California, United States

12d ago

Lead AI Engineer (AI Foundations) USD 197K-225K

AWS | Azure | C++ | Csharp | Experimentation

Senior-level Full Time

McLean, VA, United States

13d ago

Senior Solutions Architect, Gen AI USD 184K-287K

AWS | Agentic AI | Azure | Cloud platform | Cluster architecture

Equity | Health benefits

Senior-level Full Time

US, CA, Remote R

13d ago

Research Manager | Production Inference GBP 100K-178K

Autoscaling | Efficiency Improvements | Hardware utilization | Inference Optimization | LLM Inference

Annual leave | Flexible hours | Hybrid work | In-person team events | Mental health resources

Mid-level Full Time

London

13d ago

Director, Engineering - Inference Serving Engine INR 4000K-6000K

AMD GPUs | Auto-tuning | Benchmarking | CRIU | CUDA

Employee assistance program | Flexible time off | LinkedIn Learning

Executive-level Full Time

Bengaluru

13d ago

Senior AI Software Developer (Canada Remote) CAD 123K-180K

AI Agents | AWS | Agentic Systems | Data Pipelines | Data Warehousing

Health and wellness benefits | Paid time off | Professional development | Remote work

Senior-level Full Time

AMER - Canada - Ontario - … R

14d ago

Machine Learning Engineer, AI Labs TWD 1300K-2000K

Accuracy evaluation | Cache optimization | Deep learning | Distributed Systems | Inference Optimization

Senior-level Full Time

Taipei, Taiwan

17d ago

Sr. Inference Optimization Engineer (local / edge runtime) USD 195K-361K

AWQ | Batching | Build systems | C++ | CPU Kernels

Hybrid work model | On site and off site work

Senior-level Full Time

USA - CA - Santa Clara, …

17d ago

Sr. Lead AI Engineer (GenAI Platform) USD 229K-262K

AI Governance | AI Observability | AWS | Azure | C#

Health benefits | Incentive compensation | Long-term incentives

Senior-level Full Time

San Jose, CA, United States

17d ago

Distinguished AI Engineer (Remote Eligible) USD 244K-335K

AWS | Azure | C# | C++ | Experimentation

Senior-level Full Time

San Francisco, CA, United States R

17d ago

Software Engineering Manager, Google Cloud TPU

Code review | Distributed Systems | Distributed execution | Engineering Management | GPU Acceleration

Senior-level Full Time

Tel Aviv, Israel

17d ago

NLP Performance Engineer GBP 100K-140K

Benchmarking | CUDA | KV cache | LLM Inference | Language Models

Annual leave | Barista service | Company pension | Cycle to work scheme | Healthcare

Mid-level Full Time

London, United Kingdom

18d ago

Sr. Lead AI Engineer (FM Hosting, LLM Inference) USD 229K-262K

AI Governance | AWS | C# | C++ | Cost Optimization

Senior-level Full Time

New York, NY, United States

19d ago

Senior Director, AI Engineering -Agentic AI Platform(Remote Eligible) USD 286K-392K

AWS | Artificial Intelligence | Experimentation | Guardrails | Hugging Face

Mentoring and coaching culture | People leadership | Remote eligible

Senior-level Full Time

San Francisco, CA, United States R

19d ago

Find jobs in AI/ML, Data Science and Big Data