34 jobs for Distributed inference

Senior Inference Runtime Engineer TWD 1900K-2500K

CUDA | CUDA profiling | Continuous batching | Distributed inference | GPU Memory Optimization

Flexible work culture | Inclusive environment | Training and mentoring

Senior-level Full Time

Singapore, SG / Penang, MY / …

1d ago

AI Researcher USD 212K-300K

Cryptography | Distributed Training | Distributed inference | Federated Learning | Incentive design

Mid-level Full Time

Anywhere R

2d ago

ML Performance Engineer USD 100K-150K

Attention Optimization | Benchmarking | C++ | Compiler optimization | Continuous batching

Mentorship | Remote work

Senior-level Full Time

Gilbert, AZ R

4d ago

Staff Product Manager - Data Center AI Software USD 179K-268K

AI Inference | Benchmarking | Distributed Computing | Distributed inference | Docker

Senior-level Full Time

San Diego, California, United States of …

4d ago

Developer Technology Engineer - AI CNY 144K-240K

C# | C++ | CUBLAS | CUDA | CUDNN

Senior-level Full Time

China, Shanghai

6d ago

Software Engineer, AI Networking Architect

AI Model Performance | AI Model Performance Tuning | AI model | Data Analysis | Data Science

Senior-level Full Time

Israel, Tel Aviv

6d ago

AI Engineer A USD 150K-190K

Asyncio | Cloud Computing | Context engineering | Distributed Training | Distributed inference

Professional growth | Remote work

Mid-level Full Time

Remote R

6d ago

AI Research Engineer GBP 100K-200K

ATen | Asynchronous execution | C++ | CUDA | Compilation

Annual leave | Dental plan | Employee assistance program | Flexible working | Health cash plan

Mid-level Full Time

London, UK

7d ago

Senior Principal Chief Architect -Enterprise Platform/Distributed AI Infrastructure & Kubernetes/PyTorch SGD 160K-225K

Access Management | Air Gapped Frameworks | Air-gapped | Automated testing | C#

Senior-level Full Time

Singapore R

7d ago

ML Framework (MetalLM) Engineer USD 175K-312K

C# | C++ | CUDA | Compiler optimization | Compression

Senior-level Full Time

Cupertino

7d ago

Multimodal Reinforcement Learning Algorithm Researcher

Autoregressive models | CPU GPU | CPU/GPU acceleration | Deep Learning Systems | Deep learning

Senior-level Full Time

Singapore-CapitaSky

8d ago

Senior AI Solution Architect

AWS AgentCore | AWS Bedrock | Agentic Workflows | Amazon SageMaker | Artificial Intelligence

Inclusive culture | Workplace accommodations

Senior-level Full Time

Seoul, KOR

12d ago

Senior Machine Learning Engineer (Large Systems) PLN 350K-474K

C++ | CUDA | Cloud Computing | Deep learning | Distributed Training

Annual leave policy | Employee pension matched up to 4 percent | Gym card | Medical and dental health plans

Senior-level Full Time

Gdańsk, Pomeranian Voivodeship, Poland

14d ago

Senior Machine Learning Engineer (Large Systems) GBP 91K-115K

C++ | CUDA | Cloud Computing | Deep learning | Distributed Training

Annual leave | Dental plan | Employee assistance programme | Flexible interview adjustments | Flexible working

Senior-level Full Time

London, UK

14d ago

Senior Machine Learning Engineer (Large Systems) GBP 91K-115K

C plus plus | CUDA | Cloud Computing | Deep learning | Distributed Training

Dental plan | Employee assistance programme | Equal opportunity support | Flexible working | Generous annual leave

Senior-level Full Time

Cambridge, UK

14d ago

Senior Machine Learning Engineer (Large Systems) GBP 91K-115K

Benchmarking | Bottleneck analysis | C plus plus | CUDA | Cloud Computing

Annual leave | Barista bar | Dental plan | Employee assistance programme | Flexible working

Senior-level Full Time

Bristol, UK

14d ago

Senior Applied AI Engineer USD 175K-200K

Data Pipelines | Distributed inference | Fine Tuning | Guardrails | Human-in-the-loop

401k matching | Flexible work schedule | Medical/Dental/Vision insurance | Paid time off | Parental leave

Senior-level Full Time

Remote R

14d ago

Hunyuan Multimodal Algorithm Researcher (Omni-Modal) USD 158K-297K

Autoregressive models | CPU GPU | CPU/GPU acceleration | Deep learning | Diffusion Models

401k plan | Holiday pay | Life & disability benefits | Medical, dental, vision benefits | Paid sick leave

Senior-level Full Time

US-California-Palo Alto, United States

19d ago

Principal LLM Inference Engineer USD 195K-285K

Batching | C# | C++ | CUDA | CUDA kernel

Equity | Flexible working hours | Health insurance | Paid time off

Senior-level Full Time

Santa Clara

20d ago

[2026] Senior Machine Learning Engineer (Systems), Embodied AI/NPCs, ML Platform - PhD Early Career USD 196K-243K

AWS | Azure | Cloud platform | Continuous batching | Data Pipelines

Equity compensation | Health benefits | Paid time off

Senior-level Full Time

San Mateo, CA, United States R

20d ago

Senior research Scientist - Machine Learning Systems & Efficiency Engineer USD 142K-270K

AllGather | AllReduce | Artificial Intelligence | Asynchronous pipelines | Benchmarking

Senior-level Full Time

Seattle, United States R

27d ago

Senior AI Solution Architect

Agentic Workflows | Amazon AgentCore | Amazon Bedrock | Amazon Kendra | Artificial Intelligence

Senior-level Full Time

Seoul, KOR

29d ago

Senior Deep Learning Framework Communications Engineer USD 152K-287K

C++ | CUDA | CUDA kernels | CuTe | Distributed Training

Benefits | Equity

Senior-level Full Time

US, CA, Santa Clara R

1mo ago

Sr. Staff, Machine Learning Engineer (Ads Engineering)

AI Feedback | Agent Orchestration | Agent systems | Agentic AI | Autonomous Reasoning

Senior-level Full Time

Seoul, South Korea

1mo ago

Vice President AI Engineering USD 109K-142K

Agent systems | Azure | CI/CD | Cloud platform | Data Engineering

Collaborative workspaces | Employee resource groups | Flexible working arrangements | Global career paths | Inclusion programs

Executive-level Full Time

New York, NY, United States

1mo ago

Sr AI Solution Architect, AI Specialist Solutions Architect team AUD 145K-185K

Agentic Workflows | Amazon Bedrock | Amazon Web Services | Cost Optimization | Distributed inference

Senior-level Full Time

Sydney, New South Wales, AUS

1mo ago

Research Scientist, AI & Systems Co-design (PhD) USD 147K-208K

AI hardware | AI hardware accelerators | Benchmarking | CUDA | Deep learning

Mid-level Full Time

Menlo Park, CA

1mo ago

Sr AI Solution Architect, AI Specialist Solutions Architect team AUD 145K-185K

AgentCore) | Agentic Workflows | Amazon Web Services | Bedrock | Cost Optimization

Senior-level Full Time

Melbourne, Victoria, AUS

1mo ago

Principal Applied Scientist USD 200K-250K

A/B | A/B Testing | Agent Orchestration | B testing | Continuous Learning

Career growth | Hybrid work flexibility | Mentorship | Remote work option | Training opportunities

Senior-level Full Time

Bellevue

1mo ago

Senior Data Center Performance Engineer - Benchmarking and Optimization USD 184K-356K

C++ | CUDA | Containers | Distributed Training | Distributed inference

Senior-level Full Time

US, CA, Santa Clara, United States

1mo ago

Senior Deep Learning Performance Architect USD 184K-356K

Analysis | Architecture simulation | C# | C++ | Co-design

Benefits | Equity

Senior-level Full Time

US, CA, Santa Clara, United States

1mo ago

AI Inference Performance Engineer - New College Grad 2026 USD 124K-241K

Attention | Batching | C++ | CUDA | CUDA kernels

Benefits | Equity

Senior-level Full Time

US, CA, Santa Clara, United States

1mo ago

Senior Member of Technical Staff - AI Research USD 148K-246K

AWS | Algorithms | C++ | Cloud platform | Code optimization

401k | Employee stock purchasing program | Life and disability insurance | Medical/Dental/Vision | Mental health support

Senior-level Full Time

California - Palo Alto, United States

1mo ago

Machine Learning Engineer USD 145K-180K

AWS Batch | AWS EC2 | AWS Lambda | Airflow | Async Processing

Company paid life insurance | Medical, dental, and vision coverage | Mental well-being resources | Mentorship and resources | Paid parental leave

Senior-level Full Time

New York, NY, US, 10281

1mo ago

Find jobs in AI/ML, Data Science and Big Data