71 jobs for TensorRT-LLM

软件工程师 - 大模型端侧优化和部署 CNY 25K-37K

Attention | Batching | C++ | CUDA | Computational Graph Optimization

Entry-level Full Time

北京、广州、上海

17h ago

AI Solution Architect, AI 解決方案架構師 (內湖瑞光) TWD 310K-480K

AI Agent | AI Foundry | AI Search | API Gateway | AWS Bedrock

Senior-level Full Time

Taipei Neihu, Taiwan R

1d ago

ML Platform Engineer USD 100K-150K

API Gateway | Abuse detection | Automated rollback | Autoscaling | C++

100% remote | Full-time W2 employment | H1B transfer support

Senior-level Full Time

United States - Remote R

1d ago

AI Engineer (Managed Services) SGD 100K-140K

A/B | A/B Testing | AWQ | AutoAWQ | B testing

Mid-level Full Time

Singapore

4d ago

ML Platform Engineer USD 100K-150K

API Gateway | Abuse detection | Autoscaling | C++ | Caching

Senior-level Full Time

United States - Remote R

4d ago

AI Software Engineer USD 151K-332K

C++ | CUDA | CUDA kernels | CUDA profiling | Cache Management

Community involvement | Health benefits | Hybrid work options | In-person work options | Remote work options

Mid-level Full Time

Seattle (WA), United States

5d ago

ML Platform Engineer USD 100K-150K

API Gateway | Abuse detection | Automated rollback | Autoscaling | Batching

Remote work

Senior-level Full Time

United States - Remote R

5d ago

ML Platform Engineer USD 100K-150K

API Gateway | Abuse detection | Automated rollback | Autoscaling | C++

100 percent remote work | Career growth | Full-time employment

Senior-level Full Time

United States - Remote R

5d ago

ML Platform Engineer USD 100K-150K

API Gateway | Abuse detection | Automated rollback | Autoscaling | Batching

Senior-level Full Time

United States - Remote R

5d ago

Senior Machine Learning Engineer, Agentic Systems - Moveworks USD 123K-216K

C++ | Deep learning | Distributed Training | ETL | Go

Senior-level Full Time

Mountain View, CALIFORNIA, United States

5d ago

Senior Machine Learning Engineer, Agentic Systems - Moveworks USD 123K-216K

C++ | ETL | Go | Hugging Face | Microservices

Flexible work arrangements | Learning and development support | Remote work options

Senior-level Full Time

Mountain View, CALIFORNIA, United States

5d ago

Senior Solutions Architect, Generative AI Research USD 184K-287K

AI Agents | AI Feedback | Agent evaluation | Artificial Intelligence | Batching

Senior-level Full Time

US, FL, Remote, United States R

6d ago

MLOps Engineer (LLM/GenAI) GBP 27K-27K

AWS | Accelerate | Azure | Batching | CUDA

Contributory pension scheme | Enhanced maternity and adoption pay | Private healthcare | Tailored professional development opportunities | Work accommodations support

Entry-level Full Time

Sheffield, United Kingdom R

6d ago

Engineering Manager, LLM Performance USD 224K-431K

API Development | C++ | CUDA | GPU Architecture | LLM Inference

Mid-level Full Time

US, CA, Santa Clara

7d ago

MaaS 架构师 CNY 240K-480K

Attention | Batching | C++ | CUDA | Continuous batching

Senior-level Full Time

上海、北京

7d ago

AI Performance Optimization Engineer USD 100K-150K

Benchmarking | C++ | CUDA | Continuous batching | Cutlass

Remote work

Mid-level Full Time

United States - Remote R

8d ago

Director - AI Research and Engineering Efficiency (Circuit Platform) USD 259K-424K

Agent systems | Agentic Systems | Artificial Intelligence | Batching | Caching

Executive-level Full Time

USA-SAN JOSE, United States

8d ago

Sr GenAI Infra Specialist SA, AWS WWSO Startup USD 153K-228K

AWS Inferentia | AWS Trainium | Amazon Web Services | Batching | CUDA

Senior-level Full Time

New York, New York, USA

12d ago

AI运维工程师（大模型推理 / AI Infra） CNY 180K-300K

Alerting | Automation | Docker | GPU Acceleration | High Availability

Entry-level Full Time

深圳

13d ago

AI Engineer EUR 60K-80K

AWQ | AWS | Agent SDK | CI/CD | CUDA

Career growth opportunities | Permanent employment | Remote work option

Mid-level Full Time

Remote - Paris, France R

13d ago

Senior SW Engineer – AI Infrastructure & Optimization PLN 280K-383K

CUDA | Cloud Platforms | Distributed Systems | GPU Performance | GPU Performance Optimization

Senior-level Full Time

Kraków, Małopolskie, PL

14d ago

Director, Engineering - Serverless Inference INR 1962K-6000K

API Gateway | Capacity Planning | Cloud Native | Distributed Systems | Fault Tolerance

Employee assistance program | Employee stock purchase program | Flexible time off | LinkedIn Learning access | Local Employee Meetups

Executive-level Full Time

Bengaluru

14d ago

Senior Machine Learning Engineer USD 188K-282K

Adversarial Training | Calibration monitoring | Continuous batching | DPO | Deep learning

Senior-level Full Time

Palo Alto, CA

14d ago

Senior Inference Engineer, AIConfigurator for Dynamo USD 184K-356K

Batching | Distributed Systems | Expert parallelism | GPU Computing | High Performance

Equity | Health benefits | Hybrid work

Senior-level Full Time

US, CA, Santa Clara, United States

18d ago

Senior SW Engineer – AI Infrastructure & Optimization USD 184K-300K

CUDA | Cloud Platforms | GPU Performance | GPU Performance Optimization | Gateway API

Senior-level Full Time

Israel, center, IL

18d ago

Senior Solutions Architect, GPU Cloud GenAI – Infrastructure INR 2200K-5000K

Ansible | C plus plus | CI/CD | Data parallelism | Device plugin

Senior-level Full Time

India, Mumbai

19d ago

AI Engineer USD 100K-135K

AWQ | AWS | AWS EC2 | Agent Frameworks | CI/CD

401k match | Health insurance | Learning and development stipend | Paid parental leave | Paid time off

Mid-level Full Time

Remote USA - In Tandem R

19d ago

Software Engineer Graduate (Inference Infrastructure) - 2026 Start (PhD) USD 156K-316K

C++ | Cloud Native | Container Orchestration | Deep learning | Distributed Systems

Career growth | Open Source contribution | World Class Collaboration

Entry-level Full Time

San Jose, California, United States

19d ago

AI Computing Development Engineer, TensorRT and TensorRT-LLM AIGV CNY 240K-480K

C# | C++ | Computer Vision | Debugging | Deep learning

Senior-level Full Time

China, Shanghai

20d ago

Principal Machine Learning Platform Engineer (Prisma AIRS) USD 157K-254K

AWS | Apache Flink | Apache Spark | Azure | C++

Senior-level Full Time

Santa Clara, CA

22d ago

Senior Consultant Specialist (Model Hosting/Inference Optimization) CNY 144K-240K

AWQ | AWS | Batching | CPU architecture | CUDA

Senior-level Full Time

Guangzhou, Guangdong, China

25d ago

Senior Machine Learning Engineer, Agentic Systems - Moveworks USD 123K-216K

C++ | Deep learning | Distributed Training | ETL | Go

Senior-level Full Time

Mountain View, CALIFORNIA, United States

25d ago

Senior Machine Learning Engineer (Inference Platform) USD 175K-225K

AWS | Alerting | CI/CD | Continuous batching | Data Processing

Senior-level Full Time

Remote - USA R

26d ago

Principal Machine Learning Engineer

Apache Arrow | Apache Spark | DPO | Deep learning | DeepSpeed

Senior-level Full Time

Seoul, Korea

27d ago

Senior Solutions Architect, Gen AI USD 184K-287K

AWS | Agentic AI | Azure | Cloud platform | DevOps

Senior-level Full Time

US, CA, Remote, United States R

28d ago

Senior AI Architect, Foundation Models and SoC Co-Design – Autonomous Vehicles USD 208K-327K

Artificial Intelligence | Bottleneck analysis | CUDA | Deep learning | Diffusion Models

Benefits | Equity

Senior-level Full Time

US, CA, Santa Clara, United States

29d ago

Developer Relations Manager, AI Platform and Tools - MLOps USD 152K-287K

CUDA | CUDA-X | DevRel | Dynamo | Inference Serving

Mid-level Full Time

US, CA, Santa Clara, United States

1mo ago

Senior Solutions Architect - Generative AI INR 2475K-4500K

Argo | CI/CD | CUDA | Evaluation | FedRAMP

Senior-level Full Time

India, Pune

1mo ago

Engineering Manager, Inference Benchmarking — AI Perf USD 224K-356K

DCGM | Distributed Systems | GPU Telemetry | GPU observability | Helm

Senior-level Full Time

US, CA, Santa Clara, United States

1mo ago

Product Manager - AI Inference & Model Serving USD 165K-275K

AI Inference | Artificial Intelligence | Autoscaling | Cache Management | Continuous batching

Conference attendance | Professional development | Stock options | Training | Workstation provided

Mid-level Full Time

Austin, TX, United States

1mo ago

Tech Lead, Machine Learning Engineer - Global E-Commerce (Conversational AI) SGD 150K-191K

Data Curation | Deep learning | DeepSpeed | Direct Preference Optimization | Evaluation

Senior-level Full Time

Singapore, Singapore

1mo ago

AI工程师-Agent Infra & LLMOps 方向（成都） CNY 180K-360K

Access Control | AutoGPT | CPU isolation | Docker | Firecracker

None Full Time

成都

1mo ago

AI工程师-Agent Infra & LLMOps 方向（武汉） CNY 180K-360K

AutoGPT | Docker | Firecracker | GRPC | GVisor

Entry-level Full Time

武汉

1mo ago

AI工程师-Agent Infra & LLMOps 方向（北京） CNY 180K-360K

AutoGPT | Docker | Firecracker | GRPC | GVisor

Entry-level Full Time

北京

1mo ago

Intern, AI Engineering USD 64K-106K

CUDA | CUDA kernel | CUDA kernel development | Hugging Face | Inference Optimization

Entry-level Internship

San Francisco, California

1mo ago

Product Manager - AI Inference & Model Serving USD 160K-275K

AI Inference | Autoscaling | Cache Management | Cold Start | Cold Start Optimization

Conference attendance | Professional development and training | Stock options | Workstation provided

Mid-level Full Time

Austin, TX, United States

1mo ago

Associate Director, Software Engineering (Model Hosting/Inference Optimisation) CNY 240K-360K

AWQ | AWS | Accelerate | Azure | Batching

Mid-level Full Time

Shenzhen, Guangdong, China R

1mo ago

Solutions Architect - AI Technology Center, Foundation Model Building KRW 65000K-90000K

AI model | AI model development | CUDA | Debugging | Fine Tuning

Senior-level Full Time

Korea, Seoul, Korea, Republic of

1mo ago

Staff Machine Learning Engineer, Voice AI USD 220K-280K

Audio codecs | Audio signal processing | Batching | CUDA | Deep learning

Health insurance | Startup equity

Senior-level Full Time

San Francisco

1mo ago

Inference Engineer - Acceleration CHF 110K-160K

Admission control | CUDA | Cutlass | FlashAttention | KV cache

Commuting subsidy | Learning and development budget | Offsites and team events | Pension plan | Vacation days

Mid-level Full Time

Zürich, Switzerland

1mo ago

Find jobs in AI/ML, Data Science and Big Data