120 jobs for TensorRT-LLM

Performance Engineer, Inference INR 4000K-6000K

C++ | CUDA | Copy-on-write | Disaggregated Prefill | Disaggregated prefill decode

Senior-level Full Time

Bengaluru R

10h ago

AI平台与MLOps工程师(27届校招)_BCSC CNY 70K

Access Control | Alerting | Alibaba Cloud | Amazon Web Services | Argo CD

Entry-level Full Time

Wuxi, Jiangsu, China

14h ago

Principal Architect, AI/ML USD 182K-251K

AI Agent Builder | AI Evaluation | Agent Builder | Agentic Systems | Artificial Intelligence

Competitive benefits | EU or UK based eligibility | Remote work

Senior-level Full Time

EMEA (Remote) R

1d ago

Software Engineer, Inference Runtime USD 150K-350K

C++ | CPU Profiling | CUDA | Executorch | GPU Profiling

Dental insurance | Flexible PTO | Flexible WFH | Medical insurance | Team meals

Mid-level Full Time

New York City R

2d ago

Staff Software Engineer, Inference GBP 116K-155K

Autoscaling | BF16 | Benchmarking | C++ | CUDA

Critical illness cover | Employee assistance programme | Family dental insurance | Family medical insurance | Life assurance

Senior-level Full Time

London, England

3d ago

AI Engineer - Tieto Banktech (m/f/d) NOK 949K-1251K

AWS | Agent Framework | Anthropic | Azure | CI/CD

Autonomy | Collaborative culture | Hybrid working

Senior-level Full Time

Trondheim, Trøndelag, Norway R

3d ago

AI Engineer - Tieto Banktech (m/f/d) NOK 949K-1251K

AWS | Azure | CI/CD | Containerization | Docker

Autonomy | Collaborative culture | Flexible working arrangements | Hybrid working arrangement

Senior-level Full Time

Fornebu, Akershus, Norway R

3d ago

ML Systems Engineer USD 145K-165K

Autoscaling | C++ | Capacity Planning | Distributed Systems | GPU Architecture

Remote work

Senior-level Full Time

United States - Remote R

3d ago

Principal AI Engineer INR 2000K-5000K

Autogen | CI/CD | Chroma | CrewAI | Docker

Fully remote | High-impact work | Remote working options | Small team

Senior-level Full Time

India - Remote R

4d ago

ML Platform Engineer USD 100K-160K

API Gateway | Abuse detection | Autoscaling | C++ | Caching

Senior-level Full Time

Lexington, MA R

4d ago

MLOps Engineer USD 100K-150K

API Gateway | Abuse detection | Automated rollback | Autoscaling | C++

Career growth potential | Remote work

Senior-level Full Time

United States - Remote R

4d ago

ML Performance Engineer USD 100K-150K

Benchmarking | C++ | CUDA | Continuous batching | Cutlass

Senior-level Full Time

Phoenix — Ahwatukee, AZ R

4d ago

Inference Performance Engineer, AI Inference Configuration Optimization USD 124K-195K

C++ | CUDA | CUPTI | Continuous batching | KV cache

Senior-level Full Time

US, CA, Santa Clara R

4d ago

Director - AI Research and Engineering Efficiency (Circuit Platform) USD 296K-374K

Adversarial Testing | Agent Orchestration | Agent systems | Artificial Intelligence | Caching

401k matching | Basic life insurance | Dental insurance | Long-term disability | Medical insurance

Executive-level Full Time

San Jose, California, United States of …

4d ago

Ai智算平台工程师（Dmc） CNY 180K-264K

AIOps | Circuit Breaker | DCGM | Dynamic batching | Elastic scaling

Mid-level Full Time

惠州 R

4d ago

Principal AI Architect USD 195K-300K

AI Inference | AI orchestration | AIOps | BGP | Cilium

Employee resource groups | Flexible work options | Generous PTO | Hackathons | Health coverage

Senior-level Full Time

United States

5d ago

AI Computing Software Development Engineer, TensorRT-LLM TWD 1900K-2300K

C# | C++ | CPU architecture | CUDA | Debugging

Senior-level Full Time

Taiwan, Taipei

5d ago

Senior Inference Technical Product Marketing Manager - Accelerated Computing USD 148K-235K

Accelerated computing | CUDA | Competitive Analysis | Data center | Data center architecture

Senior-level Full Time

US, CA, Santa Clara

5d ago

Software Engineer, GPU Inference CAD 135K-220K

Asynchronous execution | BF16 | Benchmarking automation | Benchmarks | C++

Senior-level Full Time

US and Canada Offices

5d ago

Staff Python / PyTorch Developer — Frontend Inference Compiler – Dubai USD 175K-266K

Automated testing | C++ | Deep learning | Distributed Systems | High Throughput

Job stability | Non-corporate work culture | Open source publishing | Startup vitality

Senior-level Full Time

UAE

5d ago

Senior LLMOps Engineer USD 145K-185K

AWS | Airflow | Azure | CI/CD | Cloud platform

Senior-level Full Time

McLean, VA, United States

5d ago

MTS, AI Engineering, SMAI TWD 140K-500K

Autogen | Autoregressive Language Models | BF16 | C++ | CI/CD

Senior-level Full Time

Taichung - AATT, Taiwan

5d ago

Machine Learning Infrastructure Engineer USD 105K-143K

Autoscaling | Batching | C++ | Caching | Capacity Planning

Career growth | Remote work

Senior-level Full Time

United States - Remote R

5d ago

Senior Software Engineer – TensorRT Edge-LLM USD 152K-241K

Attention | C++ | CUDA | Compiler optimization | FlashInfer

Senior-level Full Time

US, CA, Santa Clara R

5d ago

Senior Deep Learning Algorithm Engineer USD 152K-241K

Autoscaling | C++ | Deep learning | Distributed Systems | Inference Optimization

Senior-level Full Time

US, CA, Santa Clara R

5d ago

Manager, Large Language Model Inference USD 184K-356K

API Development | C++ | CUDA | GPU Architecture | Python

Equity | Flexible work options | Health insurance | Paid time off

Mid-level Full Time

US, CA, Santa Clara R

5d ago

Engineering Manager, LLM Performance USD 224K-356K

APIs | C++ | CUDA | GPU Architecture | LLM Inference

Mid-level Full Time

US, CA, Santa Clara

5d ago

AI Optimization Engineer USD 100K-100K

C++ | Compiler optimization | Cutlass | Deep learning | DeepSpeed

Career growth | Remote work opportunity

Senior-level Full Time

United States - Remote R

5d ago

Forward Deployed Engineer (Inference & Post-Training) - Mandarin Speaking SGD 150K-205K

DPO | Fine Tuning | GRPO | KV cache | LoRA

Health insurance | Remote work flexibility | Startup equity

Senior-level Full Time

Singapore

5d ago

Senior Machine Learning Engineer, Jockey Core

Autoscaling | Batching | Capacity Planning | Disaggregated Prefill | Disaggregated prefill decode

Conference allowance | English education program | Equipment stipend | Flu vaccination support | Global buddy program

Senior-level Full Time

Seoul, South Korea

6d ago

Backend Inference Runtime Engineer Graduate (AML Inference) - 2027 Start SGD 60K-65K

Asynchronous Scheduling | Benchmarking | Cache optimization | Compilation Optimization | Distributed Systems

Entry-level Full Time

Singapore, Singapore

6d ago

Senior Forward Deployed Engineer I (AI Inference) INR 3600K-4580K

AI Inference | Continuous batching | Data parallelism | Distributed Systems | FP4

Conference reimbursement | Employee assistance program | Flexible time off | LinkedIn Learning access | Local Employee Meetups

Senior-level Full Time

Bengaluru

6d ago

Senior Consultant Specialist (Model Hosting/Inference Optimization) CNY 156K-180K

AWQ | AWS | Accelerate | Azure | Batching

Senior-level Full Time

Guangzhou, Guangdong, China R

6d ago

Data Platform Engineer USD 100K-150K

Autoscaling | C++ | Capacity Planning | Distributed Systems | FinOps

Remote work

Senior-level Full Time

United States - Remote R

6d ago

AI Field Engineer, AI infrastructure (Remote - US) A USD 220K-280K

AWS | Azure | Cloud platform | Direct Preference Optimization | Fine Tuning

Comprehensive benefits package | Remote work | Travel to enterprise customers | Visa sponsorship possible

Mid-level Full Time

San Mateo R

6d ago

机器人端侧模型运行与性能工程师 CNY 180K-360K

Asynchronous programming | C++ | CUDA | CUDA kernel | FP8

Mid-level Full Time

上海

6d ago

AI Agent Algorithm Engineer Intern (Global E-Commerce, Affiliate) - 2027 Start (PhD) SGD 45K-57K

AI Feedback | Agent Orchestration | C++ | Context Compaction | Context Editing

Community events | Industry expert collaboration | Professional development events

Entry-level Internship

Singapore

7d ago

AI Agent Algorithm Engineer Intern (Global E-Commerce, Conversational AI) - 2027 Start SGD 57K-60K

C++ | Context engineering | Data Flywheel | Deep learning | Direct Preference Optimization

Career guidance | Development workshops | Hands-on experience | Industry exposure | Social events

Entry-level Internship

Singapore

7d ago

AI Agent Algorithm Engineer Intern (Global E-Commerce, Affiliate) - 2027 Start SGD 40K-45K

Agent systems | C++ | Context engineering | Deep learning | Direct Preference Optimization

Development workshops | Hands-on experience | Industry exposure | Learning programs | Social events

Entry-level Internship

Singapore

7d ago

AI Agent Algorithm Engineer Graduate (Global E-Commerce, Conversational AI) - 2027 Start SGD 60K-65K

C++ | Context Compaction | Context Summarization | Deep learning | Direct Preference Optimization

Entry-level Full Time

Singapore

7d ago

AI Agent Algorithm Engineer Graduate (Global E-Commerce, Affiliate) - 2027 Start SGD 45K-60K

Agent runtime | C++ | Context Summarization | Deep learning | Direct Preference Optimization

Entry-level Full Time

Singapore

7d ago

AI Agent Algorithm Engineer Graduate (Global E-Commerce, Affiliate) - 2027 Start (PhD) SGD 42K-60K

C++ | Context Compaction | Context Summarization | Data Flywheel | Deep learning

Entry-level Full Time

Singapore

7d ago

Research Engineer Graduate (Monetization Technology - Business Integrity) - 2027 Start USD 145K-250K

Agentic Systems | Computer Vision | Data Pipelines | Debugging | DeepSpeed

Entry-level Full Time

San Jose, California, United States

7d ago

AI Infra Optimization Engineer Graduate (TikTok Global E-Commerce Recommendation & Search Architecture) - 2027 Start SGD 57K-60K

C# | C++ | CUDA | Cache optimization | Computation graph partitioning

Entry-level Full Time

Singapore

7d ago

Senior Developer Relations Manager INR 3000K-5500K

AI Enterprise | APIs | Batching | C++ | CI/CD

Senior-level Full Time

India, Bengaluru

7d ago

Senior Deep Learning Researcher, LLM Inference

Algorithm Optimization | Deep learning | GPU Computing | HPC | High Performance

Senior-level Full Time

Israel, Tel Aviv

7d ago

Model Serving Engineer USD 74K-98K

Autoscaling | C++ | Capacity Planning | Distributed Systems | GPU Architecture

Remote work

Senior-level Full Time

United States - Remote R

7d ago

AI Platform Engineer USD 130K-180K

API Gateways | AWS | Alerting | Authentication | Authorization

Senior-level Full Time

United States - Remote R

7d ago

Applied Agentic AI Lead, Partner Co-Design USD 224K-356K

Agent systems | Compliance | Deep learning | Docker | Fine Tuning

Equity | Health benefits

Senior-level Full Time

US, CA, Santa Clara R

7d ago

Principal Data Architect and Manager - Service Special Projects USD 150K-205K

AWS Glue | AWS Glue Catalog | AWS S3 | Apache Atlas | Apache Flink

Senior-level Full Time

Cupertino

9d ago

Find jobs in AI/ML, Data Science and Big Data