87 jobs for SGLang

Performance Engineer, Inference INR 4000K-6000K

C++ | CUDA | Copy-on-write | Disaggregated Prefill | Disaggregated prefill decode

Senior-level Full Time

Bengaluru R

8h ago

Software Engineer, Inference Runtime USD 150K-350K

C++ | CPU Profiling | CUDA | Executorch | GPU Profiling

Dental insurance | Flexible PTO | Flexible WFH | Medical insurance | Team meals

Mid-level Full Time

New York City R

2d ago

AI Engineer - Tieto Banktech (m/f/d) NOK 949K-1251K

AWS | Agent Framework | Anthropic | Azure | CI/CD

Autonomy | Collaborative culture | Hybrid working

Senior-level Full Time

Trondheim, Trøndelag, Norway R

3d ago

AI Engineer - Tieto Banktech (m/f/d) NOK 949K-1251K

AWS | Azure | CI/CD | Containerization | Docker

Autonomy | Collaborative culture | Flexible working arrangements | Hybrid working arrangement

Senior-level Full Time

Fornebu, Akershus, Norway R

3d ago

Inference Performance Engineer, AI Inference Configuration Optimization USD 124K-195K

C++ | CUDA | CUPTI | Continuous batching | KV cache

Senior-level Full Time

US, CA, Santa Clara R

4d ago

DL Performance Software Engineer - LLM Inference CAD 135K-185K

Algorithms | Autotuning | C plus plus | CUDA | Computer Architecture

Mid-level Full Time

Canada, Toronto

4d ago

Senior Infrastructure Software Engineer, TensorRT Edge-LLM USD 184K-287K

AWS | Azure | Bazel | C# | C++

Equity | Hybrid work

Senior-level Full Time

US, CA, Santa Clara R

4d ago

Senior Inference Technical Product Marketing Manager - Accelerated Computing USD 148K-235K

Accelerated computing | CUDA | Competitive Analysis | Data center | Data center architecture

Senior-level Full Time

US, CA, Santa Clara

5d ago

Software Engineer, GPU Inference CAD 135K-220K

Asynchronous execution | BF16 | Benchmarking automation | Benchmarks | C++

Senior-level Full Time

US and Canada Offices

5d ago

Staff Python / PyTorch Developer — Frontend Inference Compiler – Dubai USD 175K-266K

Automated testing | C++ | Deep learning | Distributed Systems | High Throughput

Job stability | Non-corporate work culture | Open source publishing | Startup vitality

Senior-level Full Time

UAE

5d ago

Senior Software Engineer – TensorRT Edge-LLM USD 152K-241K

Attention | C++ | CUDA | Compiler optimization | FlashInfer

Senior-level Full Time

US, CA, Santa Clara R

5d ago

Senior Deep Learning Algorithm Engineer USD 152K-241K

Autoscaling | C++ | Deep learning | Distributed Systems | Inference Optimization

Senior-level Full Time

US, CA, Santa Clara R

5d ago

Manager, Large Language Model Inference USD 184K-356K

API Development | C++ | CUDA | GPU Architecture | Python

Equity | Flexible work options | Health insurance | Paid time off

Mid-level Full Time

US, CA, Santa Clara R

5d ago

Engineering Manager, LLM Performance USD 224K-356K

APIs | C++ | CUDA | GPU Architecture | LLM Inference

Mid-level Full Time

US, CA, Santa Clara

5d ago

Forward Deployed Engineer (Inference & Post-Training) - Mandarin Speaking SGD 150K-205K

DPO | Fine Tuning | GRPO | KV cache | LoRA

Health insurance | Remote work flexibility | Startup equity

Senior-level Full Time

Singapore

5d ago

Senior Machine Learning Engineer, Jockey Core

Autoscaling | Batching | Capacity Planning | Disaggregated Prefill | Disaggregated prefill decode

Conference allowance | English education program | Equipment stipend | Flu vaccination support | Global buddy program

Senior-level Full Time

Seoul, South Korea

6d ago

Senior Forward Deployed Engineer I (AI Inference) INR 3600K-4580K

AI Inference | Continuous batching | Data parallelism | Distributed Systems | FP4

Conference reimbursement | Employee assistance program | Flexible time off | LinkedIn Learning access | Local Employee Meetups

Senior-level Full Time

Bengaluru

6d ago

Senior Consultant Specialist (Model Hosting/Inference Optimization) CNY 156K-180K

AWQ | AWS | Accelerate | Azure | Batching

Senior-level Full Time

Guangzhou, Guangdong, China R

6d ago

AI Field Engineer, AI infrastructure (Remote - US) A USD 220K-280K

AWS | Azure | Cloud platform | Direct Preference Optimization | Fine Tuning

Comprehensive benefits package | Remote work | Travel to enterprise customers | Visa sponsorship possible

Mid-level Full Time

San Mateo R

6d ago

llm服务部署工程师 CNY 240K-480K

AWQ | Agent systems | As-a-Service | C++ | CI/CD

Mid-level Full Time

北京、上海

6d ago

机器人端侧模型运行与性能工程师 CNY 180K-360K

Asynchronous programming | C++ | CUDA | CUDA kernel | FP8

Mid-level Full Time

上海

6d ago

AI Infra Optimization Engineer Graduate (TikTok Global E-Commerce Recommendation & Search Architecture) - 2027 Start SGD 57K-60K

C# | C++ | CUDA | Cache optimization | Computation graph partitioning

Entry-level Full Time

Singapore

7d ago

Senior Deep Learning Framework Communications Engineer USD 184K-287K

C++ | CUDA | CuTe | Elasticity | Fault Tolerance

Benefits | Equity

Senior-level Full Time

US, CA, Santa Clara R

7d ago

Senior AI Engineer - Services Special Projects USD 150K-260K

Adversarial evaluation | Airflow | CI/CD | Cloud Platforms | Content Moderation

Senior-level Full Time

San Francisco Bay Area

9d ago

Engineering Manager – AI Engineering BRL 1000K

Autoscaling | C++ | CUDA | DeepSpeed | Distributed Training

Mid-level Full Time

Bangalore, Karnataka

10d ago

Applied AI Engineer, Inference USD 188K-275K

Batching | Benchmarking | CUDA | GPU Utilization | Graph Capture

401k employer match | Disability insurance | Employee stock purchase program | Flexible PTO | Flexible spending account

Mid-level Full Time

Bellevue, WA/ San Francisco, CA/ Sunnyvale, …

10d ago

Agentic AI & Graph Machine Learning Research Engineer USD 128K-159K

Agent communication | Agent2Agent | AgentOps | Agentic AI | Autogen

401k match | Dental insurance | Gym facilities | Life insurance | Medical insurance

Mid-level Full Time

Calabasas, CA

11d ago

AI Engineer, Platforms SGD 60K-108K

AI Agent | AI agent orchestration | Agent Orchestration | Autoscaling | Bash

Mid-level Full Time

NTU Main Campus, Singapore

12d ago

Software Engineer Graduate (Inference Infrastructure) - 2026 Start (PhD) USD 156K-316K

Cloud Native | Containerization | Distributed Systems | GPU Acceleration | Kubernetes

Career growth | Collaborative engineering environment | Global opportunities | Open Source contribution

Entry-level Full Time

San Jose, California, United States

13d ago

Software Engineer Graduate (Inference Infrastructure) - 2026 Start (PhD) USD 148K-300K

Cloud Native | Cloud-native computing | Containerization | Distributed Systems | GPU Acceleration

Career growth | Collaborative team environment | Open source contributions

Entry-level Full Time

Seattle, Washington, United States

13d ago

Software Engineer - AI Compute Infrastructure USD 156K-387K

Cloud Native | Cluster management | Distributed Systems | GPU Acceleration | Kubernetes

Senior-level Full Time

San Jose, California, United States

13d ago

Machine Learning Engineer, AI Labs USD 128K-260K

Artificial Intelligence | Cache optimization | Distributed Systems | High Performance | High-Performance Computing

Senior-level Full Time

Santa Clara, California, United States

13d ago

Senior Solutions Architect, Gen AI USD 184K-287K

AWS | Agentic AI | Azure | Cloud platform | Cluster architecture

Equity | Health benefits

Senior-level Full Time

US, CA, Remote R

13d ago

Engineering Manager, Deep Learning Inference USD 224K-431K

Agile | C# | C++ | CUDA | Cutlass

Mid-level Full Time

US, CA, Santa Clara R

13d ago

Staff AI Engineer USD 151K-332K

C plus plus | CUDA | CUDA kernels | Continuous batching | FP8

Senior-level Full Time

Seattle (WA), United States

14d ago

Senior System Software Engineer, Agentic Inference - Dynamo USD 224K-356K

Asynchronous programming | Context Management | Deep learning | Distributed Systems | GPU

Senior-level Full Time

US, CA, Santa Clara R

14d ago

Senior Inference Engineer, GPU Kernel Optimization USD 184K-287K

C++ | CUDA | CUPTI | Cutlass | LLVM

Senior-level Full Time

US, CA, Santa Clara

14d ago

AI Researcher - Efficient AI (Contractor) USD 90K-114K

Agent systems | Cache Compression | DPO | Distillation | Hybrid Attention

401k matching | Fitness Goal Incentives | Health, dental, vision insurance | Hybrid work | Life and disability insurance

Entry-level Contract

Santa Clara, CA R

16d ago

Machine Learning Engineer, AI Labs TWD 1300K-2000K

Accuracy evaluation | Cache optimization | Deep learning | Distributed Systems | Inference Optimization

Senior-level Full Time

Taipei, Taiwan

17d ago

Senior Engineer, Inference Data Plane USD 139K-174K

Autoscaling | Continuous batching | Data parallelism | GRPC | Go

Employee assistance program | Flexible time off | Hybrid work model | LinkedIn Learning access | Local Employee Meetups

Senior-level Full Time

Seattle

17d ago

Senior Software Engineer I - AI Inference Data Plane USD 139K-174K

Autoscaling | Continuous batching | Data parallelism | Distributed Systems | GRPC

Conference reimbursement | Education reimbursement | Employee assistance program | Employee stock purchase program | Equity compensation

Senior-level Full Time

Austin R

17d ago

Senior Engineer, Inference Data Plane USD 139K-174K

Continuous batching | Data parallelism | Distributed Systems | GRPC | Go

Employee assistance program | Employee stock purchase program | Equity compensation | Flexible time off | LinkedIn Learning access

Senior-level Full Time

Denver R

17d ago

Senior Engineer, Inference Data Plane USD 139K-174K

Continuous batching | Data parallelism | Distributed Systems | GRPC | Go

Conference reimbursement | Employee assistance program | Employee stock purchase program | Equity compensation | Flexible time off

Senior-level Full Time

Boston R

17d ago

Senior Software Engineer I - AI Inference Data Plane USD 139K-174K

Autoscaling | Continuous batching | Data parallelism | Distributed Systems | GRPC

Conference reimbursement | Employee assistance program | Employee stock purchase program | Equity compensation | Flexible time off

Senior-level Full Time

San Francisco R

17d ago

NLP Performance Engineer GBP 100K-140K

Benchmarking | CUDA | KV cache | LLM Inference | Language Models

Annual leave | Barista service | Company pension | Cycle to work scheme | Healthcare

Mid-level Full Time

London, United Kingdom

18d ago

Senior Machine Learning Engineer, LLM Inference Optimization USD 195K-262K

AWQ | Benchmarking | CUDA | CUDA kernels | Chunked prefill

401k match | Career growth | Collaborative culture | Disability insurance | Flexibility

Senior-level Full Time

Palo Alto, California, United States

18d ago

AI Software Solutions Engineer CNY 84K-132K

AI accelerator | C++ | CPU | Compilers | Computer Architecture

Entry-level Full Time

CHN - Minhang, China

19d ago

Applied AI Inference Engineer USD 250K-300K

C++ | CUDA | Docker | GPU | Kubernetes

401k match | Cell phone stipend | Commuter benefits | Daily meals allowance | Emergency assistance

Senior-level Full Time

San Francisco, CA - US

19d ago

Ai院-开源模型适配 & 技术布道 CNY 144K-240K

DSA | Debugging | GitHub | Hugging Face | MLA

Mid-level Full Time

北京

19d ago

Research Scientist / Engineer – Reinforcement Learning Infrastructure USD 200K-300K

Asynchronous training | Containerization | Curriculum learning | Distributed Systems | Distributed Training

Senior-level Full Time

SF Bay Area, CA, Remote, US, … R

20d ago

Find jobs in AI/ML, Data Science and Big Data