111 jobs for LLM Inference

Principal Engineer, AI Architect INR 2000K-5000K

AI Practices | API Integration | AWS | Agent Orchestration | Azure

Senior-level Full Time

Bengaluru, India

1d ago

Staff AI Engineer - Enterprise Analysis Platform (Remote Eligible) USD 244K-335K

AI Governance | AWS | Azure | Experimentation | Go

Mentorship | Remote eligible

Senior-level Full Time

San Francisco, CA, United States R

2d ago

Staff AI Engineer role (Remote Eligible) USD 269K-307K

AI Governance | AWS | Azure | C# | C++

Remote work eligibility

Senior-level Full Time

San Francisco, CA, United States R

2d ago

Lead AI Engineer (Gen AI Platform Services: Agentic AI, Agent Guardrails, Agent Evaluation, Agent Memory) USD 197K-225K

AI Governance | AWS | Azure | C# | C++

Senior-level Full Time

San Francisco, CA, United States

2d ago

Senior Deep Learning Solution Architect CNY 160K-240K

Accelerated computing | C++ | CPU | Computer Architecture | Computer Systems

Senior-level Full Time

China, Beijing

3d ago

Solutions Architect - Financial Services CNY 360K-500K

Agentic AI | Algorithm Trading | C# | C++ | CUDA

Senior-level Full Time

China, Beijing

3d ago

ML Platform Engineer USD 100K-160K

Abuse detection | Automated rollback | Autoscaling | C++ | Caching

Remote work

Senior-level Full Time

Framingham, MA R

3d ago

AI Safety Research Associate (Computational Linguistics/Computer Science) SGD 60K-108K

Data Visualization | Generative AI | LLM Evaluation | LLM Inference | Language Models

Mid-level Full Time

NTU Main Campus, Singapore

3d ago

Senior Lead AI Engineer (GenAI Platform Services, Agentic Platform) USD 229K-262K

AWS | Azure | C# | C++ | Experimentation

Senior-level Full Time

San Jose, CA, United States

3d ago

AI Architect (Voice AI) UAH 1377K-1549K

A/B | A/B Testing | AWS Bedrock | AWS Lambda | Alerting

Senior-level Full Time

Poland R

3d ago

Senior Lead AI Engineer (AI Foundations: LLM Customization, Finetuning, Reinforcement Learning) USD 229K-262K

AI Governance | AI Safety | AWS | C# | C++

Senior-level Full Time

New York, NY, United States

4d ago

Lead AI Engineer (AI Foundations, VLM Customization) USD 197K-225K

AI Governance | AWS | Azure | C# | C++

Senior-level Full Time

New York, NY, United States

4d ago

Staff/Senior Staff Infrastructure & Site Reliability Engineer – Datacentre AI Engineering - Riyadh, KSA USD 158K-237K

Ansible | Bash | CI/CD | CloudWatch | Computer Vision

Child education allowance | Employee stock purchase scheme | Housing allowance | Life and medical insurance | Live Well reimbursement

Senior-level Full Time

Riyadh, Saudi Arabia

5d ago

Edge Computing AI Engineer USD 100K-105K

C++ | Edge inference | Embedded Systems | Federated Learning | LLM Inference

Career growth | Remote work

Mid-level Full Time

United States - Remote R

5d ago

Software Engineer, Model Runtime USD 266K-445K

Benchmarking | C++ | Compilers | Continuous batching | Distributed Systems

Senior-level Full Time

San Francisco R

5d ago

Senior AI/ML Platform Engineer USD 151K-265K

Apache Flink | Apache Spark | C++ | Caching | Data Pipelines

Senior-level Full Time

Seattle, United States R

6d ago

Senior Deep Learning Software Engineer, DLSim USD 152K-241K

Architectural simulation | C# | C++ | Compiler infrastructure | Compiler optimization

Equity | Health benefits | Paid time off

Senior-level Full Time

US, CA, Santa Clara

6d ago

Staff + Senior Software Engineer, Inference Deployment USD 320K-485K

AWS | Autoscaling | Azure | Batching | Caching

Equity donation matching | Flexible working hours | Generous vacation | Parental leave | Visa sponsorship

Senior-level Full Time

San Francisco, CA | New York … R

8d ago

Senior Research Scientist/Software Engineer, LLM/Agent Platform (TikTok-Content Ecology AI Innovation & Platform) USD 160K-230K

CUDA | Deep learning | DeepSpeed ZeRO | Distributed Systems | Evaluation Frameworks

Senior-level Full Time

San Jose, California, United States

8d ago

Lead AI Engineer (AI Foundations, LLM Core and Agentic AI) USD 197K-225K

AI Governance | AWS | Azure | C# | C++

Senior-level Full Time

New York, NY, United States

9d ago

Research Software Engineer, AI/ML USD 110K-130K

CI/CD | Docker | GPU Computing | Grafana | Kubernetes

Hybrid work arrangement | On-site work

Entry-level Full Time

Blacksburg, Virginia, Hybrid R

9d ago

Director - AI Engineering USD 168K-256K

AWS | Airflow | Asynchronous processing | Compliance | CrewAI

Career development | Open source support | Visa sponsorship

Executive-level Full Time

New York, NY, United States

9d ago

Senior Lead AI Engineer (GenAI Platform Services) USD 250K-286K

AWS | Azure | C# | C++ | Experimentation

Senior-level Full Time

New York, NY, United States

10d ago

Senior Lead AI Engineer (Gen AI Platform Services: Distributed Systems) USD 229K-262K

AI Governance | AWS | Azure | C# | C++

Senior-level Full Time

Cambridge, MA, United States

10d ago

AI Solution Architect - BytePlus SGD 149K-207K

Agentic AI | Apache Flink | Apache Spark | Docker | FastAPI

Senior-level Full Time

Singapore, Singapore

10d ago

Machine Learning Engineer, AI Search (ByteDance Singapore) SGD 108K-190K

C++ | Fine Tuning | Graph Algorithms | Human Feedback | Inference Optimization

Senior-level Full Time

Singapore, Singapore

10d ago

Research Scientist Graduate (Applied Machine Learning - ML System) - 2026 Start (PhD) USD 162K-316K

Algorithms | CUDA | Computer Architecture | Data Structures | Deep Learning Training

401k match | Life insurance | Long-term disability | Medical/Dental/Vision insurance | Paid Holidays

Entry-level Full Time

San Jose, California, United States

10d ago

Sr. Lead AI Engineer (AI Foundations) USD 209K-238K

AI Governance | AWS | Azure | C# | C++

Health benefits | Incentive compensation

Senior-level Full Time

San Jose, CA, United States

11d ago

Senior Data Infrastructure Engineer, AI Performance CNY 144K-240K

Architecture simulation | Compute Orchestration | Data Consistency | Data platform | Distributed Systems

Senior-level Full Time

China, Shanghai

11d ago

Senior Director, AI Interface Architecture USD 230K-315K

CPU | Data parallelism | DeepSpeed | Distributed Systems | Expert parallelism

Discretionary bonus | Equity | Health benefits | Medical benefits

Senior-level Full Time

San Jose Office

11d ago

[AI Research Div.] ML Serving Engineer (5년 이상) KRW 31000K-31000K

Alerting | CI/CD | CUDA | Dynamic batching | GPU

Senior-level Full Time

Seoul

12d ago

Applied AI Lead - Infrastructure & Deployment USD 107K-161K

Access Management | Air-gapped | Air-gapped systems | Authorization to Operate | Cloud Development

401k savings plan | 9 80 program | Competitive vacation | Dental insurance | Flexible work schedule

Senior-level Full Time

Beavercreek, OH, US, 45431 R

12d ago

Staff + Senior Software Engineer, Inference CAD 163K-200K

AWS | Autoscaling | Azure | Batching | Caching

Equity donation matching | Flexible working hours | Generous vacation | Parental leave

Senior-level Full Time

Ontario, CAN R

12d ago

Finance Operations Analytics Architect (Agentic AI Expertise) Technology SGD 162K-214K

API Integration | AWS | Access Management | Agent systems | Anomaly Detection

Senior-level Full Time

Location(s): Singapore, Singapore, Singapore

13d ago

Inference Systems Performance Architect USD 245K-325K

Benchmarking | Bottleneck analysis | Capacity Planning | Continuous batching | Distributed Systems

Counseling services | Dental insurance | Employee assistance program | Gym membership | Health insurance

Senior-level Full Time

San Jose, California, United States

13d ago

Compiler Engineer - AI Inference GBP 90K-104K

AI Deployment | C# | C++ | Co-design | Compiler optimization

Mid-level Full Time

Remote - UK R

16d ago

Senior Machine Learning Engineer - LLM Quantization & Deployment USD 174K-295K

Benchmarking | Calibration | Data Pipelines | FP4 | INT8

Computational resources | Dinners | Fun activities | Lunches | Snacks

Senior-level Full Time

Santa Clara, CA

16d ago

Sr. Machine Learning Engineer, Foundation Models Inference - Cloud OS & Inference USD 175K-331K

AWS | CUDA C++ | Cloud platform | Deep learning | Docker

Senior-level Full Time

Santa Clara; Seattle

16d ago

Senior Machine Learning Engineer USD 230K-265K

ASR | Cloud Computing | Computer Vision | Data Augmentation | Data Pipelines

Senior-level Full Time

Mountain View, CA

17d ago

Senior Software Development Engineer - Iris AI USD 130K-162K

.NET | API Design | Amazon Bedrock | Anthropic API | Asynchronous Architecture

Employee assistance program | Health insurance | Life insurance | Paid Company Holidays | Paid time off

Senior-level Full Time

U.S. Remote R

17d ago

Principal Engineer, AI Architect INR 2000K-5000K

AWS | Agent Orchestration | Azure | Backend architecture | Claude Code

Senior-level Full Time

Gurugram, India

17d ago

Principal Engineer, AI Architect INR 2000K-5000K

AWS | Agent Orchestration | Azure | Backend architecture | Cloud Computing

Senior-level Full Time

Remote, India R

17d ago

Senior Software Engineer, Google Distributed Cloud AI USD 174K-252K

Billing | Cloud Networking | Container Orchestration | Data Structures | Data Structures and Algorithms

Senior-level Full Time

Sunnyvale, CA, USA

17d ago

Software Engineer, Applied AI Infrastructure USD 193K-352K

Attention | Batching | CI Failure Attribution | Cloud infrastructure | Context handling

Senior-level Full Time

Mountain View, California (HQ)

18d ago

Staff Software Engineer AI/ML USD 163K-253K

A/B | A/B Testing | Autogen | B testing | Batched Inference

401k | Adoption support | Charitable giving match | Fertility care stipend | Flexible work environment

Senior-level Full Time

San Jose, California, United States

19d ago

Senior Deep Learning Architect, LLM Inference USD 152K-287K

CPU microarchitecture | Compiler optimizations | Data parallelism | Deep learning | Disaggregated serving

Equity | Health benefits

Senior-level Full Time

US, CA, Santa Clara

19d ago

Software Engineer USD 150K-253K

AI Agents | C# | C++ | Cloud Native | Concurrency

Senior-level Full Time

San Jose, CA, USA Office (SANJOSE)

19d ago

Senior Lead AI Engineer - (Gen AI Platform Services, Agentic AI) USD 229K-262K

AI Governance | AWS | Azure | Experimentation | Go

Senior-level Full Time

McLean, VA, United States

20d ago

AI Computing Software Development Engineer, TensorRT-LLM TWD 1000K-1300K

C++ | CPU architecture | CUDA | Debugging | Deep learning

Mid-level Full Time

Taiwan, Taipei

20d ago

Lead Machine Learning Engineer USD 144K-248K

AWS | Agentic AI | Amazon Athena | CI/CD | Docker

401k matching | Bereavement leave | Dental insurance | Fitness and wellness stipend | Jury duty leave

Senior-level Full Time

New York R

23d ago

Find jobs in AI/ML, Data Science and Big Data