78 jobs for TensorRT-LLM

#Hiring | Senior Security Architect | Post-Quantum Cryptography (PQC) | AI/LLM Security | Frisco, TX (Onsite) USD 167K-246K

Backstage IDP | Confidential Computing | Confidential Computing TEE | Cryptography Agility | EBPF

Senior-level Contract Full Time

Frisco, TX, United States

1d ago

AI Performance Optimization Engineer USD 100K-150K

C++ | CUDA | Continuous batching | Cutlass | Deep learning

Career growth | Health benefits | Remote work

Mid-level Full Time

United States - Remote R

2d ago

Principal Machine Learning Platform Engineer (Prisma AIRS) USD 157K-254K

AWS | Apache Flink | Apache Spark | Azure | C++

Senior-level Full Time

Santa Clara, CA

2d ago

AI Software Engineer USD 151K-332K

C plus plus | CUDA | CUDA kernel | Continuous batching | FP8

Mid-level Full Time

Seattle (WA), United States

2d ago

Senior Consultant Specialist (Model Hosting/Inference Optimization) CNY 144K-240K

AWQ | AWS | Batching | CPU architecture | CUDA

Senior-level Full Time

Guangzhou, Guangdong, China

4d ago

AI Performance Optimization Engineer USD 100K-150K

Benchmarking | C++ | Compiler optimization | Continuous batching | Cutlass

Benefits | Full-time employment | Remote work

Mid-level Full Time

United States - Remote R

5d ago

Senior Machine Learning Engineer, Agentic Systems - Moveworks USD 123K-216K

C++ | Deep learning | Distributed Training | ETL | Go

Senior-level Full Time

Mountain View, CALIFORNIA, United States

5d ago

Senior Machine Learning Engineer (Inference Platform) USD 175K-225K

AWS | Alerting | CI/CD | Continuous batching | Data Processing

Senior-level Full Time

Remote - USA R

6d ago

Principal Machine Learning Engineer

Apache Arrow | Apache Spark | DPO | Deep learning | DeepSpeed

Senior-level Full Time

Seoul, Korea

7d ago

Senior Solutions Architect, Gen AI USD 184K-287K

AWS | Agentic AI | Azure | Cloud platform | DevOps

Senior-level Full Time

US, CA, Remote, United States R

8d ago

Senior AI Architect, Foundation Models and SoC Co-Design – Autonomous Vehicles USD 208K-327K

Artificial Intelligence | Bottleneck analysis | CUDA | Deep learning | Diffusion Models

Benefits | Equity

Senior-level Full Time

US, CA, Santa Clara, United States

9d ago

Developer Relations Manager, AI Platform and Tools - MLOps USD 152K-287K

CUDA | CUDA-X | DevRel | Dynamo | Inference Serving

Mid-level Full Time

US, CA, Santa Clara, United States

12d ago

Senior Solutions Architect - Generative AI INR 2475K-4500K

Argo | CI/CD | CUDA | Evaluation | FedRAMP

Senior-level Full Time

India, Pune

13d ago

Engineering Manager, Inference Benchmarking — AI Perf USD 224K-356K

DCGM | Distributed Systems | GPU Telemetry | GPU observability | Helm

Senior-level Full Time

US, CA, Santa Clara, United States

13d ago

Product Manager - AI Inference & Model Serving USD 165K-275K

AI Inference | Artificial Intelligence | Autoscaling | Cache Management | Continuous batching

Conference attendance | Professional development | Stock options | Training | Workstation provided

Mid-level Full Time

Austin, TX, United States

13d ago

Tech Lead, Machine Learning Engineer - Global E-Commerce (Conversational AI) SGD 150K-191K

Data Curation | Deep learning | DeepSpeed | Direct Preference Optimization | Evaluation

Senior-level Full Time

Singapore, Singapore

15d ago

AI工程师-Agent Infra & LLMOps 方向（成都） CNY 180K-360K

Access Control | AutoGPT | CPU isolation | Docker | Firecracker

None Full Time

成都

19d ago

AI工程师-Agent Infra & LLMOps 方向（武汉） CNY 180K-360K

AutoGPT | Docker | Firecracker | GRPC | GVisor

Entry-level Full Time

武汉

19d ago

AI工程师-Agent Infra & LLMOps 方向（北京） CNY 180K-360K

AutoGPT | Docker | Firecracker | GRPC | GVisor

Entry-level Full Time

北京

19d ago

Intern, AI Engineering USD 64K-106K

CUDA | CUDA kernel | CUDA kernel development | Hugging Face | Inference Optimization

Entry-level Internship

San Francisco, California

20d ago

Machine Learning Engineer, Distributed vLLM USD 136K-287K

API Gateway | Cilium | Distributed Systems | Envoy | GPU Profiling

Paid parental leave | Paid time off | Retirement 401k match | Tuition reimbursement

Mid-level Full Time

Boston, United States R

20d ago

Product Manager - AI Inference & Model Serving USD 160K-275K

AI Inference | Autoscaling | Cache Management | Cold Start | Cold Start Optimization

Conference attendance | Professional development and training | Stock options | Workstation provided

Mid-level Full Time

Austin, TX, United States

20d ago

Senior AI Engineer USD 160K-250K

API Design | Agent Orchestration | Agent systems | Audit Logging | Authentication

401k eligibility | Flexible work environment | Hybrid work option | Paid time off | Parental leave eligibility

Senior-level Full Time

United States (Remote) R

20d ago

Associate Director, Software Engineering (Model Hosting/Inference Optimisation) CNY 240K-360K

AWQ | AWS | Accelerate | Azure | Batching

Mid-level Full Time

Shenzhen, Guangdong, China R

20d ago

Sr GenAI Infra Specialist SA, AWS WWSO Startup USD 153K-228K

AWS | Amazon EC2 | Amazon EKS | Amazon S3 | Cache optimization

Inclusive team culture | Mentorship and career growth | Work-life balance

Senior-level Full Time

New York, New York, USA

21d ago

Solutions Architect - AI Technology Center, Foundation Model Building KRW 65000K-90000K

AI model | AI model development | CUDA | Debugging | Fine Tuning

Senior-level Full Time

Korea, Seoul, Korea, Republic of

21d ago

Staff Machine Learning Engineer, Voice AI USD 220K-280K

Audio codecs | Audio signal processing | Batching | CUDA | Deep learning

Health insurance | Startup equity

Senior-level Full Time

San Francisco

21d ago

Staff AI Platform Engineer - Abu Dhabi USD 139K-300K

Alerting | Azure | CI/CD | Distributed tracing | Docker

Senior-level Full Time

Amman, Amman Governorate, Jordan

22d ago

Inference Engineer - Acceleration CHF 110K-160K

Admission control | CUDA | Cutlass | FlashAttention | KV cache

Commuting subsidy | Learning and development budget | Offsites and team events | Pension plan | Vacation days

Mid-level Full Time

Zürich, Switzerland

22d ago

Software Engineer, Inference - Multi Modal USD 295K-555K

Distributed Systems | GPU | High Throughput | Inference | Language Models

Entry-level Full Time

San Francisco

24d ago

大模型应用架构师 CNY 240K-480K

Agent Frameworks | C++ | Caching | Canary Deployment | Concurrency Control

Senior-level Full Time

北京

26d ago

Member of Technical Staff, AI Engineering USD 162K-297K

Autogen | BF16 | C++ | CI/CD | CUDA

Income Protection for Illness or Injury | Medical, dental, vision plans | Paid Holidays | Paid family leave | Paid time off

Senior-level Full Time

Boise, ID - Main Site, United …

27d ago

Senior Deep Learning Research Engineer, LLM Inference

Deep learning | Evaluation Pipelines | GPU Cluster | High Performance | High-Performance Computing

Senior-level Full Time

Israel, Tel Aviv

28d ago

Solutions Architect, Pre-training and Post-training KRW 65000K-90000K

Artificial Intelligence | Debugging | Deep learning | Fine Tuning | GPU Architecture

Senior-level Full Time

Korea, Seoul, Korea, Republic of

28d ago

AI Platform Engineer INR 1500K-2500K

Automated Evaluation | CI/CD | CUDA | Continuous Checkpointing | Continuous batching

Mid-level Full Time

Bangalore, India

28d ago

Tech Lead Core Software Engineer

C++ | CMake | Conan | Docker | Inference Optimization

Senior-level Full Time

Israel

28d ago

AI Engineer - Tieto Banktech (m/f/d) NOK 792K-1075K

AWS | Anthropic | Azure | CI/CD | Docker

Autonomy | Collaborative culture | Hybrid working

Mid-level Full Time

Trondheim, Trøndelag, Norway

29d ago

AI Engineer - Tieto Banktech (m/f/d) NOK 792K-1075K

AWS | Anthropic | Azure | CI/CD | Cloud platform

Hybrid working

Mid-level Full Time

Trondheim, Trøndelag, Norway

29d ago

AI Engineer - Tieto Banktech (m/f/d) NOK 792K-1075K

AWS | Agentic Workflows | Anthropic | Azure | CI/CD

Flexible hybrid working

Mid-level Full Time

Fornebu, Akershus, Norway

29d ago

AI Engineer - Tieto Banktech (m/f/d) NOK 792K-1075K

AWS | Agent Frameworks | Azure | CI/CD | Cloud platform

Autonomy | Flexible hybrid working | Knowledge sharing

Mid-level Full Time

Bergen, Vestland, Norway

29d ago

AI Engineer - Tieto Banktech (m/f/d) NOK 792K-1075K

AWS | Agent Frameworks | Anthropic API | Azure | CI/CD

Autonomy | Collaborative culture | Flexible hybrid working

Mid-level Full Time

Bergen, Vestland, Norway

29d ago

【26届校招】Software Engineer (All Levels) – 大模型与智能机器人系统 CNY 240K-480K

C++ | CUDA | DDS | GPU memory | GPU memory management

None Full Time

广州、深圳

29d ago

Solution Architect (AI/LLM Inference) USD 165K-330K

Artificial Intelligence | Benchmarking | Embeddings | GPU Selection | Image Generation

401k company match | Fertility and family building stipend | Flexible PTO | Medical/Dental/Vision insurance | Paid parental leave

Senior-level Full Time

San Francisco

30d ago

Machine Learning Engineer, Inference & Serving (Speech LLM) - San Francisco USD 180K-270K

AWQ | Audio codecs | Audio streaming | Autoscaling | Chunked prefill

401k matching | Annual offsites | Dental coverage | Employer-paid training | Healthcare benefits

Mid-level Full Time

San Francisco, CA

1mo ago

Machine Learning Engineer, Speech LLM Training - San Francisco USD 180K-270K

Automatic Speech Recognition | DeepSpeed | Distributed Training | FSDP | GPU Memory Optimization

401k matching | Healthcare Dental Vision | Hybrid work | New parent leave | Office Stocked

Mid-level Full Time

San Francisco, CA

1mo ago

Forward Deployed Engineer (Inference & Post-Training) USD 270K-300K

DPO | GRPO | KV cache | LoRA | Pipeline parallelism

Equity | Health insurance | Remote work flexibility

Senior-level Full Time

San Francisco

1mo ago

Staff Software Engineer, Inference USD 188K-275K

BF16 | C++ | CUDA | Distributed Systems | FP8

401k employer match | Dental insurance | Employee stock purchase program | Flexible PTO | Flexible spending account

Senior-level Full Time

Sunnyvale, CA / Bellevue, WA

1mo ago

Principal AI/ML Engineer EUR 60K-93K

ASR | Agent coordination | CI/CD | Context Management | DPO

Senior-level Full Time

Iraklio, Greece

1mo ago

Audio Inference Engineer, Model Efficiency USD 165K-300K

C++ | Deep learning | Distributed inference | GPU Programming | Low-level system

Co-working stipend | Health and dental benefits | Inclusive culture | Mental health budget | Parental leave top-up

Mid-level Full Time

New York

1mo ago

【26届校招】Software Engineer (All Levels) – 大模型与智能机器人系统 CNY 240K-480K

C++ | CUDA | DDS | Linux | ROS 1

None Full Time

广州、深圳

1mo ago

Find jobs in AI/ML, Data Science and Big Data