53 jobs for Tensor Parallelism

Backend Inference Runtime Engineer Graduate (AML Inference) - 2027 Start USD 128K-256K

Asynchronous execution | Benchmarking | CUDA | Cache optimization | Compilation Optimization

Entry-level Full Time

San Jose, California, United States

4d ago

ML Performance Engineer USD 100K-150K

Benchmarking | C++ | CUDA | Continuous batching | Cutlass

Senior-level Full Time

Phoenix — Ahwatukee, AZ R

4d ago

Senior Deep Learning Sofware Infrastructure Engineer USD 224K-356K

Automation | DDP | Data loading | Datacenter Networking | Distributed Training

Senior-level Full Time

US, CA, Remote R

4d ago

Senior Principal AI Engineer USD 129K-190K

Activation checkpointing | Cluster Orchestration | Data parallelism | DeepSpeed | Distributed communication

Senior-level Full Time

Remote - USA, United States R

4d ago

Senior Software Architect, AI Networking ILS 420K-504K

C++ | CUDA | Cluster scheduling | Compute scheduling | Deep learning

Senior-level Full Time

Israel, Tel Aviv

5d ago

Senior Research Scientist, Efficient Deep Learning USD 192K-304K

Adaptive Inference | Architecture Search | C++ | CUDA | Computer Vision

Senior-level Full Time

US, CA, Santa Clara

5d ago

Senior Software Architect, AI Networking ILS 420K-504K

C++ | CUDA | Congestion Control | Deep learning | Distributed Systems

Senior-level Full Time

Israel, Tel Aviv

5d ago

Software Engineer, GPU Inference CAD 135K-220K

Asynchronous execution | BF16 | Benchmarking automation | Benchmarks | C++

Senior-level Full Time

US and Canada Offices

5d ago

Senior Software Engineer – TensorRT Edge-LLM USD 152K-241K

Attention | C++ | CUDA | Compiler optimization | FlashInfer

Senior-level Full Time

US, CA, Santa Clara R

5d ago

Senior Software Engineer, CUDA Deep Learning Systems USD 184K-356K

C++ | CUDA | Computer Architecture | Deep Learning Compilers | Deep learning

Benefits | Equity

Senior-level Full Time

US, CA, Santa Clara R

5d ago

Software Engineer, CUDA Deep Learning Systems USD 124K-195K

C++ | CUDA | Code generation | Computer Architecture | Deep Learning Compilers

Equity | Health benefits

Mid-level Full Time

US, CA, Santa Clara R

5d ago

Forward Deployed Engineer (Inference & Post-Training) - Mandarin Speaking SGD 150K-205K

DPO | Fine Tuning | GRPO | KV cache | LoRA

Health insurance | Remote work flexibility | Startup equity

Senior-level Full Time

Singapore

5d ago

Backend Inference Runtime Engineer Graduate (AML Inference) - 2027 Start SGD 60K-65K

Asynchronous Scheduling | Benchmarking | Cache optimization | Compilation Optimization | Distributed Systems

Entry-level Full Time

Singapore, Singapore

6d ago

Senior Forward Deployed Engineer I (AI Inference) INR 3600K-4580K

AI Inference | Continuous batching | Data parallelism | Distributed Systems | FP4

Conference reimbursement | Employee assistance program | Flexible time off | LinkedIn Learning access | Local Employee Meetups

Senior-level Full Time

Bengaluru

6d ago

具身大模型训练框架工程师 CNY 240K-480K

CUDA | CUDA graph | Data parallelism | DeepSpeed | Distributed Training

Senior-level Full Time

上海 R

6d ago

NLP AI Engineer USD 130K-180K

AWS | Cloud platform | DeepSpeed ZeRO | Direct Preference Optimization | Distributed Training

100 percent remote U.S. | Direct W2

Senior-level Full Time

United States - Remote R

7d ago

Senior Performance Co-design Engineer, LLM Training USD 174K-252K

C++ | Co-design | Computer Architecture | Data parallelism | Distributed Training

Senior-level Full Time

Sunnyvale, CA, USA

10d ago

Research Engineer, Large-Scale Training USD 200K-290K

CUDA | Communication collectives | Data parallelism | Deep learning | DeepSpeed

Health insurance | Startup equity

Senior-level Full Time

San Francisco

11d ago

Gen AI Engineer AUD 116K-116K

Agile | Agile Framework | Apache Spark | BitsAndBytes | Canary Deployment

401k match | Health, dental, vision insurance | Life insurance | Paid Holidays | Paid time off

Mid-level Full Time

GA-ATLANTA, 740 W PEACHTREE ST NW, …

11d ago

具身大模型训练框架工程师-觅蜂子公司 CNY 500K-500K

C++ | CPU Optimization | CUDA | CUDA graph | Communication overlap

Entry-level Full Time

上海 R

12d ago

Staff/Principal DevOps Engineer, AI Inference USD 192K-272K

AWS IAM | AWS S3 | Amazon EC2 | Amazon EKS | Amazon VPC

Commuter benefits | Company Subsidized Lunch Program | Company holidays | Dental insurance | Educational assistance

Senior-level Full Time

Cambridge, MA USA

13d ago

Staff Software Engineer, GPU Inference USD 175K-260K

Asynchronous execution | Benchmarking | C++ | CI/CD | CUDA

Senior-level Full Time

Toronto Office

13d ago

Backend Engineer - AML Framework Development (Search, Ads, and Recommendation Direction) SGD 170K-225K

Asynchronous Scheduling | CUDA | Cache optimization | Compilation Optimization | Distributed Systems

Senior-level Full Time

Singapore, Singapore

13d ago

Staff Software Engineer - AI Platform USD 175K-287K

Apache Beam | Apache Flink | Apache Spark | C# | C++

Health and wellness programs | Time away

Senior-level Full Time

Mountain View, CA, United States

13d ago

Senior Software Engineer - AI Platform USD 144K-236K

Apache Beam | C# | C++ | CUDA | CUDA optimization

Health and wellness programs | Time off

Senior-level Full Time

Mountain View, CA, United States

13d ago

Senior Engineer, Inference Data Plane USD 139K-174K

Autoscaling | Continuous batching | Data parallelism | GRPC | Go

Employee assistance program | Flexible time off | Hybrid work model | LinkedIn Learning access | Local Employee Meetups

Senior-level Full Time

Seattle

17d ago

Senior Software Engineer I - AI Inference Data Plane USD 139K-174K

Autoscaling | Continuous batching | Data parallelism | Distributed Systems | GRPC

Conference reimbursement | Education reimbursement | Employee assistance program | Employee stock purchase program | Equity compensation

Senior-level Full Time

Austin R

17d ago

Senior Engineer, Inference Data Plane USD 139K-174K

Continuous batching | Data parallelism | Distributed Systems | GRPC | Go

Employee assistance program | Employee stock purchase program | Equity compensation | Flexible time off | LinkedIn Learning access

Senior-level Full Time

Denver R

17d ago

Senior Engineer, Inference Data Plane USD 139K-174K

Continuous batching | Data parallelism | Distributed Systems | GRPC | Go

Conference reimbursement | Employee assistance program | Employee stock purchase program | Equity compensation | Flexible time off

Senior-level Full Time

Boston R

17d ago

Senior Software Engineer I - AI Inference Data Plane USD 139K-174K

Autoscaling | Continuous batching | Data parallelism | Distributed Systems | GRPC

Conference reimbursement | Employee assistance program | Employee stock purchase program | Equity compensation | Flexible time off

Senior-level Full Time

San Francisco R

17d ago

PhD Thesis: Optimization of LLM / FM Inference in Industrial Edge Networks EUR 69K-108K

C plus plus | Foundation Models | Language Models | Large Language Models | Linux

30 leave days | Continuous learning | Flexible working models | Share matching programs

Senior-level Full Time

Garching - - Germany

20d ago

Research Scientist / Engineer – Reinforcement Learning Infrastructure USD 200K-300K

Asynchronous training | Containerization | Curriculum learning | Distributed Systems | Distributed Training

Senior-level Full Time

SF Bay Area, CA, Remote, US, … R

20d ago

Senior Inference Runtime Engineer TWD 1900K-2500K

CUDA | CUDA profiling | Continuous batching | Distributed inference | GPU Memory Optimization

Flexible work culture | Inclusive environment | Training and mentoring

Senior-level Full Time

Singapore, SG / Penang, MY / …

21d ago

Lead Machine Learning Engineer (Foundation Models) SGD 162K-238K

C++ | DPO | Deep learning | DeepSpeed | Distributed Training

Birthday leave | Employee assistance programme | FlexWork | Flexible benefits | Medical insurance

Senior-level Full Time

Singapore, Singapore

24d ago

大模型推理架构师 CNY 144K-240K

Ascend C | C plus plus | C# | CUDA | CUDA kernel

Senior-level Full Time

上海

25d ago

Foundation AI Engineer (LLM) CAD 100K-110K

AI Feedback | Attention Mechanisms | Constitutional AI | Constitutional Safety Tuning | Data Curation

Annual health checkups | Healthcare insurance | Opportunity to collaborate with industry professionals | Performance bonuses | Preferential pricing for services

Mid-level Full Time

Hanoi, Vietnam

26d ago

Senior DevOps/ MLOps Engineer USD 100K-150K

AWS | ArgoCD | Bash | CI/CD | CUDA

Annual health checkups | Collaborative learning opportunities | Health insurance | Preferential employee pricing

Senior-level Full Time

Hanoi, Vietnam

26d ago

ML Framework (MetalLM) Engineer USD 175K-312K

C# | C++ | CUDA | Compiler optimization | Compression

Senior-level Full Time

Cupertino

27d ago

优才-具身大模型训练框架工程师-觅蜂子公司 CNY 500K-500K

C++ | CPU Optimization | CUDA | CUDA graph | Communication overlap

Mid-level Full Time

上海 R

1mo ago

Senior AI Infrastructure Engineer - Model Training USD 190K-260K

BF16 | C++ | CUDA | Data parallelism | DeepSpeed

401k | Dental and vision plans | Dependent care FSA | Dog-friendly office | FSA

Senior-level Full Time

Mountain View, CA

1mo ago

Senior AI scientist INR 3715K-5449K

ALiBi | Adafactor Optimizer | AdamW | Attention Mechanisms | BF16

Senior-level Full Time

Remote - India R

1mo ago

AI Engineer (Managed Services) SGD 85K-138K

A/B | A/B Testing | AWQ | AutoAWQ | B testing

Mid-level Full Time

Singapore

1mo ago

Tech Lead Manager, Inference USD 207K-300K

Autoscaling | Cache Management | Caching | Continuous batching | Deployment Pipelines

Senior-level Full Time

SF Bay Area, CA

1mo ago

Sr. Engineering Manager, AI Runtime USD 228K-297K

Checkpointing | DeepSpeed | Distributed Systems | Elastic Training | FSDP

Senior-level Full Time

Mountain View, California; San Francisco, California

1mo ago

Staff ML Engineer - Ads ML Infrastructure USD 175K-312K

Deep learning | Distributed Systems | Feature Stores | GPU Kernels | High Performance

Senior-level Full Time

Cupertino; New York City

1mo ago

Senior AI Scientist USD 123K-197K

ALiBi | Adafactor | AdamW | Attention | BF16

Annual bonus opportunity | Company RRSP contribution | Equity awards | Hybrid work | Insurance coverage

Senior-level Full Time

Remote - USA, United States R

1mo ago

Principal LLM Inference Engineer USD 195K-285K

Batching | C# | C++ | CUDA | CUDA kernel

Equity | Flexible working hours | Health insurance | Paid time off

Senior-level Full Time

Santa Clara

1mo ago

Staff ML Engineer, Generative Model Performance & Efficiency USD 251K-310K

Data parallelism | Diffusion Models | Efficient Attention | Expert parallelism | Flax

Senior-level Full Time

Mountain View, California, United States, New …

1mo ago

Senior AI Infra Engineer - Large Model Inference Systems (Multimodal/LLM/VLM) USD 198K-368K

Attention Mechanisms | Batching | CUDA | Data parallelism | Distributed Systems

Senior-level Full Time

San Jose, California, United States

1mo ago

Senior AI Infra Engineer - Large Model Training Infrastructure (LLM/VLM /Agent RL) USD 207K-300K

Attention Mechanisms | Data parallelism | Deep learning | Distributed Training | Language Models

Senior-level Full Time

San Jose, California, United States

1mo ago

Find jobs in AI/ML, Data Science and Big Data