38 jobs for Distributed inference

AI Performance Optimization Engineer USD 100K-150K

Benchmarking | C++ | Communication Primitives | Continuous batching | Distributed Training

Career growth potential | Remote work

Mid-level Full Time

United States - Remote R

1d ago

Software Engineer, AI Networking Architect

AI serving | Application understanding | Data Analysis | Data Science | Deep learning

Senior-level Full Time

Israel, Tel Aviv

1d ago

AI Researcher USD 247K-340K

Cryptography | Distributed Systems | Distributed Training | Distributed inference | Federated Learning

Mid-level Full Time

Anywhere R

2d ago

Senior Data Center Performance Engineer - Benchmarking and Optimization USD 184K-356K

C++ | CUDA | Containers | Distributed Training | Distributed inference

Senior-level Full Time

US, CA, Santa Clara, United States

4d ago

AI Performance Optimization Engineer USD 100K-150K

Access Optimization | Attention Mechanisms | Benchmarking | C++ | Communication Primitives

Mid-level Full Time

United States - Remote R

5d ago

Senior Deep Learning Performance Architect USD 184K-356K

Analysis | Architecture simulation | C# | C++ | Co-design

Benefits | Equity

Senior-level Full Time

US, CA, Santa Clara, United States

6d ago

AI Inference Performance Engineer - New College Grad 2026 USD 124K-241K

Attention | Batching | C++ | CUDA | CUDA kernels

Benefits | Equity

Senior-level Full Time

US, CA, Santa Clara, United States

6d ago

AI Solution Specialist, ANZ (Sydney/Melbourne-based) AUD 120K-152K

AI Application Development | AI application | AI infrastructure | Application development | Artificial Intelligence

Travel opportunities

Executive-level Full Time

Remote Australia R

10d ago

Senior Member of Technical Staff - AI Research USD 148K-246K

AWS | Algorithms | C++ | Cloud platform | Code optimization

401k | Employee stock purchasing program | Life and disability insurance | Medical/Dental/Vision | Mental health support

Senior-level Full Time

California - Palo Alto, United States

12d ago

Machine Learning Engineer USD 145K-180K

AWS Batch | AWS EC2 | AWS Lambda | Airflow | Async Processing

Company paid life insurance | Medical, dental, and vision coverage | Mental well-being resources | Mentorship and resources | Paid parental leave

Senior-level Full Time

New York, NY, US, 10281

12d ago

Senior Machine Learning Engineer (Large Systems) GBP 90K-110K

Benchmarking | C++ | CUDA | CUDA kernels | Cloud Computing

Annual leave | Bereavement Support | Dental plan | Employee assistance programme | Equal opportunity process

Senior-level Full Time

Bristol, UK

14d ago

Senior Engineer (ML Engineer) GBP 80K-110K

Automation | Benchmarking | CI/CD | Debugging | Distributed Training

Dental plan | Employee assistance programme | Flexible working | Generous annual leave | Generous parental leave

Senior-level Full Time

Cambridge, UK

18d ago

Senior Engineer (ML Engineer) GBP 80K-110K

Benchmarking | CI/CD | Debugging | Distributed Training | Distributed inference

Annual leave | Dental plan | Employee assistance programme | Flexible working | Health cash plan

Senior-level Full Time

Bristol, UK

18d ago

Staff Engineer (ML Engineer) GBP 80K-110K

Benchmarking | CI/CD | Distributed Training | Distributed inference | JAX

Annual leave | Dental plan | Employee assistance programme | Flexible working | Health cash plan

Senior-level Full Time

Cambridge, UK

18d ago

LLM Engineer (LLM Evaluation)

Argo Workflows | Asynchronous programming | Benchmarking | Data Monitoring | Datadog

Senior-level Full Time

Pangyo (Software Dream Center), South Korea

19d ago

Solution Architect, Computer Vision – Media and Entertainment EUR 55K-72K

3D Rendering | Cloud Computing | Computer Vision | Containerization | DeepStream

Senior-level Full Time

France, Courbevoie

19d ago

AI Research Engineer (Model Compression & Quantization) - 100% Remote Worldwide USD 203K-330K

Compute Shaders | Diffusion Models | Distributed inference | Edge Computing | Expert parallelism

100 percent remote

Senior-level Full Time

Remote job R

21d ago

AI Research Engineer (Kernel & Inference Optimization) USD 201K-332K

Compute Shaders | Diffusion Models | Distributed inference | Edge Computing | Expert parallelism

English communication support | Remote work

Senior-level Full Time

Remote job R

21d ago

AI Research Engineer (Kernel & Inference Optimization) USD 201K-332K

Diffusion Models | Distributed Inference Systems | Distributed inference | Edge Computing | Expert parallelism

Remote work

Senior-level Full Time

Remote job R

21d ago

AI Research Engineer (Kernel & Inference Optimization) - 100% Remote Worldwide USD 202K-325K

Diffusion Models | Distributed Inference Systems | Distributed inference | Expert parallelism | Flash Attention

100 percent remote | Worldwide remote

Senior-level Full Time

Remote job R

21d ago

AI Research Engineer (Kernel & Inference Optimization) USD 200K-332K

Compute Shaders | Diffusion Models | Distributed Inference Systems | Distributed inference | Edge Computing

Remote work

Senior-level Full Time

Remote job R

23d ago

AI Research Engineer (Kernel & Inference Optimization) USD 200K-332K

Computer Vision | Deep learning | Diffusion Models | Distributed inference | Edge Computing

Remote work

Senior-level Full Time

Remote job R

23d ago

AI Research Engineer (Kernel & Inference Optimization) USD 200K-332K

Compute Shaders | Diffusion Models | Distributed Inference Systems | Distributed inference | Edge Computing

Remote work

Senior-level Full Time

Remote job R

23d ago

AI Research Engineer (Kernel & Inference Optimization) USD 200K-332K

Diffusion Models | Distributed Inference Systems | Distributed inference | Edge Computing | Expert parallelism

Career growth | Collaborative research environment | English communication support | Remote work opportunity

Senior-level Full Time

Remote job R

23d ago

AI Research Engineer (Kernel & Inference Optimization) USD 200K-332K

Compute Shaders | Custom Compute Shaders | Data Pipelines | Diffusion Models | Distributed Inference Systems

Remote work

Senior-level Full Time

Remote job R

23d ago

Senior Machine Learning Engineer USD 152K-250K

Automation | Distributed Training | Distributed inference | GPU | Go

401k | Employee assistance program | Flexible PTO | Flexible spending account | Health savings account contributions

Senior-level Full Time

Las Vegas, Nevada

23d ago

AI Researcher, LLMs USD 200K-300K

Dataset curation | Distributed Training | Distributed inference | Fine Tuning | GPU Computing

Entry-level Full Time

London, United Kingdom; New York, NY, …

25d ago

Senior AI Architect, APAC SGD 120K-135K

AI Platform | Artificial Intelligence | Containerization | Data Pipelines | Deep learning

Senior-level Full Time

Singapore R

26d ago

Machine Learning Solutions Engineer (ML + Infrastructure Focus) USD 150K-195K

Amazon EKS | Artificial Intelligence | Autoscaling | Batching | Bin packing

Comprehensive medical/dental/vision coverage | Flexible work environment | Paid parental leave | Paid time off | Professional development support

Senior-level Full Time

New York, New York, United States

27d ago

Large Model Training Acceleration Engineer USD 187K-387K

Benchmarking | Data parallelism | Deep learning | Distributed Training | Distributed inference

Mid-level Full Time

San Jose, California, United States

27d ago

Senior Solutions Architect, AI Hyperscalers USD 184K-356K

CUDA | Cloud Computing | Containerization | Data Science | Distributed Training

Senior-level Full Time

US, CA, Santa Clara, United States

27d ago

Engineering Manager - Forward Deployed Engineering (LLM) USD 260K-380K

Distributed inference | Docker | GPU infrastructure | Hugging Face | LLM Inference

Company 401K | Fertility and family building stipend | Flexible PTO | Medical, dental, and vision insurance | Paid parental leave

Mid-level Full Time

San Francisco

1mo ago

Audio Inference Engineer, Model Efficiency USD 165K-300K

C++ | Deep learning | Distributed inference | GPU Programming | Low-level system

Co-working stipend | Health and dental benefits | Inclusive culture | Mental health budget | Parental leave top-up

Mid-level Full Time

New York

1mo ago

Senior Software Development Engineer (AI/ML and GenAI Engineer) INR 2000K-4500K

AWS | Agentic AI | Autogen | Azure | CrewAI

Agile work environment | Cross-functional team collaboration | Mentorship opportunities

Senior-level Full Time

Mumbai, Maharashtra, India

1mo ago

Machine Learning Manager, Notifications Relevance USD 230K-322K

Artificial Intelligence | Deep learning | Distributed Training | Distributed inference | Machine Learning

401k employer match | Caregiving support | Coaching benefits | Family planning support | Flexible vacation

Mid-level Full Time

Remote - United States R

1mo ago

Machine Learning Engineer - Enterprise CAD 143K-200K

Agentic Systems | Cloud Platforms | Data Security | Distributed Training | Distributed inference

Senior-level Full Time

Toronto

1mo ago

Senior AI Architect, APAC THB 2040K-2520K

Agile | Containerization | Data Pipelines | Deep learning | DevOps

Career mentoring | Open source technology work | Travel up to 40 percent

Senior-level Full Time

Bangkok - MSO - Gaysorn, Thailand R

1mo ago

Hunyuan Multimodal Algorithm Researcher Intern(Omni-Modal) USD 80K-124K

Autoregressive models | CPU/GPU acceleration | Deep learning | Diffusion Models | Distributed Training

Medical plan | Paid Holidays | Paid sick leave

Entry-level Full Time Internship

US-California-Palo Alto, United States

1mo ago

Find jobs in AI/ML, Data Science and Big Data