69 jobs for TensorRT-LLM

Software Engineer, Machine Learning Infrastructure GBP 28K-28K

APIs | AWS | Batch inference | Cost Optimization | DPO

Mid-level Full Time

London - The River Building HQ

1d ago

Senior Inference Runtime Engineer TWD 1900K-2500K

CUDA | CUDA profiling | Continuous batching | Distributed inference | GPU Memory Optimization

Flexible work culture | Inclusive environment | Training and mentoring

Senior-level Full Time

Singapore, SG / Penang, MY / …

1d ago

Data Platform Engineer USD 100K-150K

API Gateway | Abuse detection | Automated rollback | Autoscaling | C++

Senior-level Full Time

United States - Remote R

1d ago

MLOps Engineer USD 100K-150K

API Gateway | Abuse detection | Automated rollback | Autoscaling | C++

Senior-level Full Time

United States - Remote R

1d ago

Model Optimization Engineer USD 100K-150K

C++ | CUDA | Continuous batching | Deep learning | DeepSpeed

Senior-level Full Time

United States - Remote R

1d ago

ML Systems Engineer USD 100K-150K

API Gateways | Abuse detection | Automated rollback | Autoscaling | Batching

Senior-level Full Time

United States - Remote R

1d ago

Model Serving Engineer USD 100K-150K

API Gateway | Abuse detection | Automated rollback | Autoscaling | C++

Direct W2 employment | Remote work

Senior-level Full Time

United States - Remote R

1d ago

ML Performance Engineer USD 100K-150K

Benchmarking | C++ | Continuous batching | Cutlass | Deep learning

Career growth | Direct W2 employment | Remote work

Senior-level Full Time

Tempe, AZ R

1d ago

AI Inference Engineer GBP 80K-106K

Autoscaling | Batching | CUDA | Cache Management | Capacity Planning

Biannual bonus | Breakfast allowance | Dinner allowance | Equity sign-on bonus | Expensed technology

Mid-level Full Time

London, England, United Kingdom - Remote R

1d ago

Machine Learning Infrastructure Engineer USD 100K-150K

API Gateway | Abuse detection | Automated rollback | Autoscaling | C++

Senior-level Full Time

United States - Remote R

4d ago

MLOps Engineer USD 100K-150K

API Gateway | Abuse detection | Automated rollback | Autoscaling | C++

Career growth | Remote work

Senior-level Full Time

United States - Remote R

4d ago

Director - AI Research and Engineering Efficiency (Circuit Platform) USD 291K-369K

AI Governance | Agentic Systems | Artificial Intelligence | Batching | Caching

Paid time off

Executive-level Full Time

USA-SAN JOSE, United States

4d ago

Machine Learning Infrastructure Tech Lead USD 200K-300K

Batching | Benchmarking | CUDA | Distributed Systems | GPU Utilization

Commuter reimbursement | Daily lunch | Dental insurance | Health and wellness budget | Health insurance

Senior-level Full Time

San Francisco Office

4d ago

Member of Technical Staff (Software Engineer, Inference & Training Platform) USD 250K-485K

Autoscaling | C++ | CRD | CUDA | Cluster management

Senior-level Full Time

San Francisco

4d ago

ML Platform Engineer USD 100K-160K

API Gateway | Abuse detection | Automated rollback | Autoscaling | C++

Senior-level Full Time

Jersey City (India Square), NJ R

5d ago

Model Optimization Engineer USD 100K-150K

Benchmarking | C++ | CUDA | Continuous batching | Cutlass

Senior-level Full Time

United States - Remote R

5d ago

ML Systems Engineer USD 100K-150K

API Gateway | Abuse detection | Automated rollback | Autoscaling | C++

Senior-level Full Time

United States - Remote R

5d ago

模型推理系统工程师 CNY 216K-420K

Batching | C++ | CUDA | CUDA graph | FP8

None Full Time

上海

5d ago

大模型推理架构师 CNY 144K-240K

Ascend C | C plus plus | C# | CUDA | CUDA kernel

Senior-level Full Time

上海

5d ago

Data Platform Engineer USD 100K-150K

API Gateway | Automated rollback | Autoscaling | C++ | Caching

Senior-level Full Time

United States - Remote R

6d ago

Senior Machine Learning Engineer, Agentic Systems - Moveworks USD 161K-274K

C++ | Deep learning | Distributed Training | ETL Pipelines | Go

Senior-level Full Time

Mountain View, CALIFORNIA, United States

6d ago

Senior Software Engineer - GPU Kernel Authoring & Optimization USD 182K-242K

Benchmarking | C++ | CUDA | CUDA programming | CUDALibs

401k match | Flexible PTO | Medical/Dental/Vision insurance | Paid parental leave | Tuition reimbursement

Senior-level Full Time

Sunnyvale, CA / Bellevue, WA

6d ago

Senior Staff / Principal Machine Learning Scientist, AI Inference & Optimization USD 182K-260K

Attention | Batching | C++ | CoreML | Fine Tuning

Senior-level Full Time

Santa Clara, California, United States

7d ago

Applied Agentic AI Lead, Partner Co-Design USD 224K-431K

Agent systems | Compliance | Deep learning | Docker | Fine Tuning

Benefits | Equity

Senior-level Full Time

US, CA, Santa Clara R

7d ago

Senior Software Engineer, Inference Platform GBP 225K-325K

API Gateway | Authentication | Authorization | Autoscaling | Batching

Equity | Flexible work options | Wellness benefits

Senior-level Full Time

London, England, United Kingdom

7d ago

Senior Forward Deployed ML Engineer, Agents GBP 145K-200K

AWS | Azure | CI/CD | Cloud platform | Computer Vision

Equity | Flexible work options | Wellness benefits

Senior-level Full Time

London, England, United Kingdom

7d ago

Systems Research Engineer GBP 74K-121K

AI infrastructure | C++ | Data Locality | Distributed Systems | Fault Tolerance

None Full Time

Edinburgh, United Kingdom

9d ago

AI Engineer (Managed Services) SGD 85K-138K

ARES | AWQ | Agent Orchestration | Agent systems | Attention Mechanisms

Mid-level Full Time

Singapore

11d ago

Senior Machine Learning Engineer USD 212K-292K

Batching | Caching | Distributed Systems | Embeddings | GPU Acceleration

Senior-level Full Time

Hybrid R

11d ago

大模型推理与部署优化工程师 CNY 240K-480K

Ascend 910B | Ascend CANN | Autoscaling | CUDA | Continuous batching

Entry-level Full Time

北京

12d ago

AI Engineer (Managed Services) SGD 85K-138K

A/B | A/B Testing | AWQ | AutoAWQ | B testing

Mid-level Full Time

Singapore

12d ago

AI运维工程师（大模型推理 / AI Infra） CNY 180K-300K

Docker | GPU Cluster | GPU Memory Optimization | GPU memory | Inference acceleration

Entry-level Full Time

深圳

13d ago

Tech Lead Manager, Inference USD 207K-300K

Autoscaling | Cache Management | Caching | Continuous batching | Deployment Pipelines

Senior-level Full Time

SF Bay Area, CA

13d ago

Manager, Deep Learning Algorithms USD 224K-431K

Debugging | Deep learning | GPU Computing | Inference Optimization | Jira

Conference participation | Customer site visits | Equity | Travel opportunities

Mid-level Full Time

US, CA, Santa Clara

14d ago

Software Engineer - Training/Inference (C++) USD 180K-440K

Auto Scaling | C++ | CI/CD | CUDA | Code generation

401k plan | Dental insurance | Disability insurance | Discounts | Health insurance

Senior-level Full Time

Palo Alto, CA

14d ago

Research Engineer, Post-Training Inference USD 200K-290K

24 7 Availability | CUDA | Fine Tuning | GPU | Go

Mid-level Full Time

San Francisco

14d ago

Senior Consultant Specialist (Model Hosting/Inference Optimization) CNY 120K-180K

AWQ | AWS | Accelerate | Azure | Batching

Senior-level Full Time

Guangzhou, GD, CN, 510620

17d ago

Senior Software Engineer, RL Post-Training Frameworks EUR 90K-140K

C# | C++ | CPUs | CUDA | Container lifecycle

Comprehensive benefits | Family benefits | Health insurance | Paid time off

Senior-level Full Time

Remote - Germany R

18d ago

Senior Associate/Manager - Applied AI Engineer, Technology Consulting SGD 162K-220K

ALiBi | AWS | AWS CDK | Attention Mechanisms | Autoscaling

Senior-level Full Time

SG, 048583

18d ago

Software Engineer, Machine Learning Infrastructure - Generative AI USD 137K-299K

APIs | AWQ | AWS | Autoscaling | Backend Development

401k plan | Commuter benefits | Paid parental leave | Paid sick leave | Paid time off

Mid-level Full Time

San Francisco, CA; Sunnyvale, CA; Seattle, …

18d ago

Senior Software Engineer, Inference USD 152K-204K

BF16 | C++ | CI/CD | CUDA | CUDA kernels

401k employer match | Company paid life insurance | Employee stock purchase program | Flexible PTO | Flexible spending account

Senior-level Full Time

Sunnyvale, CA / Bellevue, WA

19d ago

Senior ML Engineer (Token Factory) GBP 75K-130K

Attention | CI/CD | CUDA | Cutlass | FP8

Career growth and learning opportunities | Collaborative and innovative culture | Flexibility | International environment | Opportunity to work on impactful AI projects

Senior-level Full Time

Amsterdam, Netherlands; Berlin, Germany; Israel; London, … R

20d ago

Principal LLM Inference Engineer USD 195K-285K

Batching | C# | C++ | CUDA | CUDA kernel

Equity | Flexible working hours | Health insurance | Paid time off

Senior-level Full Time

Santa Clara

20d ago

软件工程师 - 大模型端侧优化和部署 CNY 25K-37K

Attention | Batching | C++ | CUDA | Computational Graph Optimization

Entry-level Full Time

北京、广州、上海

21d ago

AI Solution Architect, AI 解決方案架構師 (內湖瑞光) TWD 310K-480K

AI Agent | AI Foundry | AI Search | API Gateway | AWS Bedrock

Senior-level Full Time

Taipei Neihu, Taiwan R

22d ago

Senior Machine Learning Engineer, Agentic Systems - Moveworks USD 123K-216K

C++ | Deep learning | Distributed Training | ETL | Go

Senior-level Full Time

Mountain View, CALIFORNIA, United States

26d ago

Senior Machine Learning Engineer, Agentic Systems - Moveworks USD 123K-216K

C++ | ETL | Go | Hugging Face | Microservices

Flexible work arrangements | Learning and development support | Remote work options

Senior-level Full Time

Mountain View, CALIFORNIA, United States

26d ago

Senior Solutions Architect, Generative AI Research USD 184K-287K

AI Agents | AI Feedback | Agent evaluation | Artificial Intelligence | Batching

Senior-level Full Time

US, FL, Remote, United States R

27d ago

Engineering Manager, LLM Performance USD 224K-431K

API Development | C++ | CUDA | GPU Architecture | LLM Inference

Mid-level Full Time

US, CA, Santa Clara

28d ago

MaaS 架构师 CNY 240K-480K

Attention | Batching | C++ | CUDA | Continuous batching

Senior-level Full Time

上海、北京

28d ago

Find jobs in AI/ML, Data Science and Big Data