88 jobs for SGLang

Inference Intern - Spring 2027 USD 60K-142K

C++ | Compilers | Consensus Protocols | Consistency models | Distributed Systems

Daily Dinner | Daily lunch | Direct mentorship | Housing support | Paid internship

Entry-level Internship

San Jose

1d ago

Staff Machine Learning Engineer, Voice AI USD 220K-280K

Audio codecs | Audio signal processing | Batching | CUDA | Deep learning

Health insurance | Startup equity

Senior-level Full Time

San Francisco

1d ago

AI Software Engineer, Kernel Libraries - New College Grad 2026 USD 124K-241K

Apache TVM | C++ | CUDA | CuTile | FlashAttention

Employee benefits | Equity

Senior-level Full Time

US, CA, Santa Clara, United States

2d ago

Staff Engineer USD 191K-239K

AMD GPU | Apache Yunikorn | Autoscaling | Bin packing | CRIU

Conference reimbursement | Education reimbursement | Employee assistance program | Employee stock purchase program | Equity compensation

Senior-level Full Time

Seattle

2d ago

大模型 Infra 研发实习生（Agentic RL 方向） CNY 25K-37K

Asynchronous programming | Concurrency | Distributed Systems | Docker | Git

Entry-level Internship

深圳

2d ago

大模型 Infra 研发实习生（Agentic RL 方向） CNY 25K-37K

Alerting | Asynchronous programming | Concurrency | Data Retrieval | Data Storage

Entry-level Internship

深圳

2d ago

大模型 Infra 研发实习生（Agentic RL 方向） CNY 25K-37K

Alerting | Asynchronous programming | Concurrency | Data pipeline | Distributed Systems

Entry-level Internship

深圳

2d ago

大模型 Infra 研发实习生（Agentic RL 方向） CNY 25K-37K

Asynchronous programming | Concurrency | Distributed Systems | Docker | Git

Flexible work schedule | Internship opportunity | Mentorship

Entry-level Internship

深圳

2d ago

AI Platform Engineer, Training and Inference USD 150K-225K

ANN indexing | BF16 | DDP | Embeddings | FP8

Career growth | Learning opportunities

Senior-level Full Time

San Francisco

2d ago

Inference Engineer - Acceleration CHF 110K-160K

Admission control | CUDA | Cutlass | FlashAttention | KV cache

Commuting subsidy | Learning and development budget | Offsites and team events | Pension plan | Vacation days

Mid-level Full Time

Zürich, Switzerland

2d ago

Staff Software Engineer, AI/ML Heterogeneous Systems TWD 1500K-1900K

C++ | CUDA | KVCaching | LLVM | MLIR

Senior-level Full Time

Hsinchu, Taiwan

6d ago

AI Software Engineer USD 151K-332K

C++ | CUDA | CUDA kernels | Continuous batching | FP16

Mid-level Full Time

Seattle (WA), United States

6d ago

Senior ML Engineer- Poland PLN 267K-402K

API Integration | Accelerator systems | Caching | Decode | GPU Computing

Senior-level Full Time

Kraków, Małopolskie, PL

6d ago

大模型应用架构师 CNY 240K-480K

Agent Frameworks | C++ | Caching | Canary Deployment | Concurrency Control

Senior-level Full Time

北京

6d ago

Senior Product Manager (LLM API Platform) SGD 180K-191K

API Design | API Gateway | API Management | Cost of ownership | Developer experience

Senior-level Full Time

Crimson House Singapore

7d ago

Machine Learning Engineer, Distributed vLLM USD 136K-225K

API Gateway | Cilium | Envoy | GPU Profiling | GRPC

Flexible spending account | Health savings account | Paid parental leave plans | Paid time off and holidays | Retirement 401k with employer match

Mid-level Full Time

Boston, United States R

7d ago

Senior Deep Learning Engineering - Autonomous Vehicles USD 224K-356K

Computer Vision | DPO | Deep learning | Fine Tuning | GRPO

Benefits | Equity

Senior-level Full Time

US, CA, Santa Clara, United States

7d ago

Senior Deep Learning Frameworks CUDA Software Engineer USD 184K-356K

AI compilers | C++ | CUDA | Distributed machine learning | HPC communication

Senior-level Full Time

US, CA, Santa Clara, United States

7d ago

ML Infrastructure Engineer A EUR 78K-108K

CUDA | Deep learning | Distributed Training | Docker | GPU Performance

Career development | Continuous learning | Flexible remote work | International work environment | Technical ownership

Mid-level Full Time

Germany

7d ago

AI Platform Engineer INR 1500K-2500K

Automated Evaluation | CI/CD | CUDA | Continuous Checkpointing | Continuous batching

Mid-level Full Time

Bangalore, India

8d ago

Software Engineering Manager, LLM Training USD 170K-277K

CUDA | Containerization | Context Parallelism | Data I/O | Data parallelism

Entry-level Full Time

Mountain View, CA, United States

8d ago

Senior AI LLM Data Scientist/Engineer A

AWS | AWS Lambda | Amazon SageMaker | Cost estimation | Data Science

Flexible work schedule | Foreign business trips | Free English classes | Health insurance | Modern office facilities

Senior-level Full Time

Lviv, Lviv Oblast, Ukraine

8d ago

AI Engineer - Tieto Banktech (m/f/d) NOK 792K-1075K

AWS | Anthropic | Azure | CI/CD | Docker

Autonomy | Collaborative culture | Hybrid working

Mid-level Full Time

Trondheim, Trøndelag, Norway

8d ago

AI Engineer - Tieto Banktech (m/f/d) NOK 792K-1075K

AWS | Anthropic | Azure | CI/CD | Cloud platform

Hybrid working

Mid-level Full Time

Trondheim, Trøndelag, Norway

8d ago

AI Engineer - Tieto Banktech (m/f/d) NOK 792K-1075K

AWS | Agentic Workflows | Anthropic | Azure | CI/CD

Flexible hybrid working

Mid-level Full Time

Fornebu, Akershus, Norway

8d ago

AI Engineer - Tieto Banktech (m/f/d) NOK 792K-1075K

AWS | Agent Frameworks | Azure | CI/CD | Cloud platform

Autonomy | Flexible hybrid working | Knowledge sharing

Mid-level Full Time

Bergen, Vestland, Norway

8d ago

AI Platform Engineer INR 1500K-2500K

Alerting | CUDA | Cause analysis | Continuous batching | GPU Profiling

Mid-level Full Time

Bangalore, India

9d ago

【26届校招】大语言模型后训练算法工程师（Foundation Model） CNY 240K-480K

Data loading | Distributed Training | Docker | Fine Tuning | Inference Optimization

Entry-level Full Time

上海、深圳

9d ago

AI/ML Engineering Manager CAD 152K-234K

AWS Bedrock | AWS CDK | AWS CloudFormation | AWS Lambda | AWS SageMaker

Equipment and office stipend | Flexible PTO | Fully remote | Learning and development stipend | Medical insurance

Mid-level Full Time

CANADA R

9d ago

Solution Architect (AI/LLM Inference) USD 165K-330K

Artificial Intelligence | Benchmarking | Embeddings | GPU Selection | Image Generation

401k company match | Fertility and family building stipend | Flexible PTO | Medical/Dental/Vision insurance | Paid parental leave

Senior-level Full Time

San Francisco

10d ago

Staff Forward Deployed Engineer USD 195K-239K

Artificial Intelligence | Benchmarking | CUDA | CUDA Interconnect | Continuous batching

Employee assistance program | Flexible time off | Hybrid work | LinkedIn Learning | Local Employee Meetups

Senior-level Full Time

Seattle

12d ago

Staff Forward Deployed Engineer USD 195K-239K

Artificial Intelligence | Benchmarking | CUDA | Continuous batching | CrewAI

Conference reimbursement | Employee assistance program | Employee stock purchase program | Flexible time off | LinkedIn Learning

Senior-level Full Time

San Francisco R

12d ago

Machine Learning Engineer, Inference & Serving (Speech LLM) - San Francisco USD 180K-270K

AWQ | Audio codecs | Audio streaming | Autoscaling | Chunked prefill

401k matching | Annual offsites | Dental coverage | Employer-paid training | Healthcare benefits

Mid-level Full Time

San Francisco, CA

12d ago

Machine Learning Engineer, Speech LLM Training - San Francisco USD 180K-270K

Automatic Speech Recognition | DeepSpeed | Distributed Training | FSDP | GPU Memory Optimization

401k matching | Healthcare Dental Vision | Hybrid work | New parent leave | Office Stocked

Mid-level Full Time

San Francisco, CA

12d ago

Forward Deployed Engineer (Inference & Post-Training) USD 270K-300K

DPO | GRPO | KV cache | LoRA | Pipeline parallelism

Equity | Health insurance | Remote work flexibility

Senior-level Full Time

San Francisco

13d ago

Machine Learning Ops Engineer SGD 120K-143K

AWS CloudFormation | AWS ECR | AWS ECS | AWS EKS | AWS IAM

Mid-level Full Time

SGP-Head Office, Singapore

14d ago

Senior Data Scientist USD 200K-225K

AWS | Airflow | ArgoCD | Batching | CUDA

401k match | Dental insurance | FSA options | Flexible PTO | Free food

Senior-level Full Time

Marina del Rey, CA

14d ago

Audio Inference Engineer, Model Efficiency USD 165K-300K

C++ | Deep learning | Distributed inference | GPU Programming | Low-level system

Co-working stipend | Health and dental benefits | Inclusive culture | Mental health budget | Parental leave top-up

Mid-level Full Time

New York

14d ago

Staff AI Architect, Family AI Lab USD 197K-290K

Access Control | Audit Logging | Batching | Caching | Cloud services

401k company matching or RRSP DPSP plan | Employee assistance program | Equipment and tools reimbursement | Flexible PTO | Learning and development programs

Senior-level Full Time

Remote, USA R

14d ago

Staff AI Software Engineer USD 180K-220K

AWS | Azure | CI/CD | Cloud platform | Containerization

401k match | Flexible work hours | Free snacks and drinks | Gaming area | Health, Vision, Dental, Life Insurance

Senior-level Full Time

Chicago, IL

15d ago

【26届校招】大语言模型后训练算法工程师（Foundation Model） CNY 240K-480K

Axolotl | Cloud Computing | Data loading | Distributed Training | Docker

Entry-level Full Time

上海、深圳

15d ago

Distinguished Engineer, Machine Learning USD 147K-299K

Artificial Intelligence | Cache optimization | Inference Optimization | KV cache | KV cache optimization

Senior-level Full Time

Santa Clara, California, United States

15d ago

Senior Deep Learning Software Engineer, Inference USD 184K-356K

Agile | C# | C++ | CUDA | Cutlass

Employee benefits | Equity

Senior-level Full Time

US, CA, Santa Clara, United States

16d ago

Research Scientist - Pretraining-Daten für Foundation Models (all genders) EUR 53K-53K

Apache Spark | Common Crawl | Dask | Data Deduplication | Data Generation

Access to high-performance infrastructure | Collaborative team environment | Deutschlandticket subsidy | Diversity training | Employer pension

Mid-level Full Time

Dresden, DE, 01069

17d ago

Senior Software Engineer, AI Inference Systems PLN 292K-507K

Algorithms | C++ | CI/CD | CUDA | CUDA Graphs

Hybrid work

Senior-level Full Time

Germany, Remote R

20d ago

AI Engineer - Model Performance USD 165K-250K

Attention Backend | Audio Processing | Batching | CUDA | CUDA graph

Async communication | Innovation-focused culture | Remote work | Startup environment | Supportive team

Mid-level Full Time

SF Hybrid R

20d ago

AI Engineer - Tieto Banktech (m/f/d) SEK 396K-480K

AWS | Anthropic | Azure | CI/CD | Docker

Autonomy | Collaborative culture | Hybrid working

Mid-level Full Time

Solna, Sweden

20d ago

大语言模型后训练算法工程师 CNY 240K-480K

Distributed Training | Docker | Fine Tuning | GPU Training | Kubernetes

Mid-level Full Time

深圳、上海

23d ago

Manager, Machine Learning Operations (MLOps) USD 170K-230K

AWS | ArgoCD | CI/CD | Cost Optimization | DBT

401k match | FSA options | Flexible PTO | Flexible hybrid work schedule | Life insurance

Mid-level Full Time

Marina del Rey, CA

23d ago

Senior Machine Learning Engineer USD 160K-250K

Caching | Cloud Platforms | GPU Computing | Kubernetes | LLM Inference

Senior-level Full Time

Israel, center, IL

23d ago

Find jobs in AI/ML, Data Science and Big Data