83 jobs for SGLang

软件工程师 - 大模型端侧优化和部署 CNY 25K-37K

Attention | Batching | C++ | CUDA | Computational Graph Optimization

Entry-level Full Time

北京、广州、上海

17h ago

AI Solution Architect, AI 解決方案架構師 (內湖瑞光) TWD 310K-480K

AI Agent | AI Foundry | AI Search | API Gateway | AWS Bedrock

Senior-level Full Time

Taipei Neihu, Taiwan R

1d ago

Software Dev Engineer II, Stores Foundational AI -SFAI USD 165K-223K

Async Rollouts | Batching | C++ | CUDA | Cluster computing

401k matching | Adoption reimbursement | Dental insurance | Employee assistance program | Flexible spending accounts

Mid-level Full Time

Palo Alto, California, USA

1d ago

Software Dev Engineer II, Stores Foundational AI -SFAI USD 143K-194K

CUDA | Data Pipelines | Distributed Training | Dynamo | Experiment tracking

401k matching | Employee assistance program | Health insurance | Paid time off | Parental leave

Mid-level Full Time

Seattle, Washington, USA

1d ago

Senior MLOps Engineer

AWS | Amazon EC2 | Amazon EKS | Amazon RDS | Amazon S3

Senior-level Full Time

Abu Dhabi

2d ago

Senior Forward Deployed Engineer II (AI/ML) INR 1800K-3500K

Agents SDK | CUDA | Cache optimization | Continuous batching | CrewAI

Mid-level Full Time

Bengaluru

3d ago

Senior Forward Deployed Engineer I (AI/ML) INR 3000K-4800K

Agents SDK | CUDA | Continuous batching | CrewAI | Data Compression

Hybrid work | Travel up to 30%

Senior-level Full Time

Bengaluru

3d ago

AI Engineer (Managed Services) SGD 100K-140K

A/B | A/B Testing | AWQ | AutoAWQ | B testing

Mid-level Full Time

Singapore

4d ago

R&D Engineer CNY 28K-50K

AI Agents | Control Systems | Deep learning | Industrial Control Systems | Industrial control

Entry-level Full Time

Shanghai, Shanghai, China

4d ago

Machine Learning Engineer USD 128K-260K

Artificial Intelligence | Cache optimization | Inference | KV cache | KV cache optimization

Senior-level Full Time

Santa Clara, California, United States

4d ago

AI Software Engineer USD 151K-332K

C++ | CUDA | CUDA kernels | CUDA profiling | Cache Management

Community involvement | Health benefits | Hybrid work options | In-person work options | Remote work options

Mid-level Full Time

Seattle (WA), United States

5d ago

AI Engineer THB 4000K-5000K

Chunking | Cost Tracking | Docker | Embeddings | Guardrails

Senior-level Full Time

Bangkok, Bangkok, Thailand

6d ago

MLOps Engineer (LLM/GenAI) GBP 27K-27K

AWS | Accelerate | Azure | Batching | CUDA

Contributory pension scheme | Enhanced maternity and adoption pay | Private healthcare | Tailored professional development opportunities | Work accommodations support

Entry-level Full Time

Sheffield, United Kingdom R

6d ago

AI Engineer (AI Products) SGD 12K-60K

API Development | CI/CD | Checkpointing | Cloud Platforms | Compute Optimization

Mid-level Full Time

NTU Main Campus, Singapore

7d ago

Engineering Manager, LLM Performance USD 224K-431K

API Development | C++ | CUDA | Distributed Systems | GPU Architecture

Equity | Health benefits | Hybrid work

Mid-level Full Time

US, CA, Santa Clara, United States

7d ago

Engineering Manager, LLM Performance USD 224K-431K

API Development | C++ | CUDA | GPU Architecture | LLM Inference

Mid-level Full Time

US, CA, Santa Clara

7d ago

MaaS 架构师 CNY 240K-480K

Attention | Batching | C++ | CUDA | Continuous batching

Senior-level Full Time

上海、北京

7d ago

大模型 Infra 研发实习生（Agentic RL 方向） CNY 25K-37K

Asynchronous programming | Concurrency | Distributed Systems | Docker | GRPO

Entry-level Internship

深圳

7d ago

Senior Deep Learning Framework Communications Engineer USD 152K-287K

C++ | CUDA | CUDA kernels | CuTe | Distributed Training

Benefits | Equity

Senior-level Full Time

US, CA, Santa Clara R

10d ago

AI运维工程师（大模型推理 / AI Infra） CNY 180K-300K

Alerting | Automation | Docker | GPU Acceleration | High Availability

Entry-level Full Time

深圳

13d ago

AI Engineer EUR 60K-80K

AWQ | AWS | Agent SDK | CI/CD | CUDA

Career growth opportunities | Permanent employment | Remote work option

Mid-level Full Time

Remote - Paris, France R

13d ago

Senior SW Engineer – AI Infrastructure & Optimization PLN 280K-383K

CUDA | Cloud Platforms | Distributed Systems | GPU Performance | GPU Performance Optimization

Senior-level Full Time

Kraków, Małopolskie, PL

14d ago

Director, Engineering - Inference Serving Engine INR 1500K-6000K

Auto Scaling | Benchmarking | CRIU | CUDA | Checkpoint Restore

Employee assistance program | Flexible time off | LinkedIn Learning access | Local Employee Meetups | Training and education reimbursement

Executive-level Full Time

Bengaluru

14d ago

Director, Engineering - Forward Deployed Engineering INR 1500K-5199K

AI infrastructure | AI orchestration | Agentic Systems | Agents SDK | Automation

Conference reimbursement | Employee assistance program | Employee stock purchase program | Flexible time off | LinkedIn Learning access

Executive-level Full Time

Bengaluru

14d ago

Senior Machine Learning Engineer USD 188K-282K

Adversarial Training | Calibration monitoring | Continuous batching | DPO | Deep learning

Senior-level Full Time

Palo Alto, CA

14d ago

ML Software Engineer, Data Plane

C++ | CI/CD | Computer Architecture | Distributed Systems | Dynamo

Senior-level Full Time

Tel Aviv-Yafo, Tel Aviv, ISR

15d ago

Senior Inference Engineer, AIConfigurator for Dynamo USD 184K-356K

Batching | Distributed Systems | Expert parallelism | GPU Computing | High Performance

Equity | Health benefits | Hybrid work

Senior-level Full Time

US, CA, Santa Clara, United States

18d ago

Senior SW Engineer – AI Infrastructure & Optimization USD 184K-300K

CUDA | Cloud Platforms | GPU Performance | GPU Performance Optimization | Gateway API

Senior-level Full Time

Israel, center, IL

18d ago

Applied Scientist II, Sponsored Products USD 172K-223K

AWS Neuron | Algorithms | C plus plus | Data Mining | Data Structures

401k matching | Dental insurance | EAP | Health insurance | Mental health support

Mid-level Full Time

New York, New York, USA

19d ago

AI Engineer USD 100K-135K

AWQ | AWS | AWS EC2 | Agent Frameworks | CI/CD

401k match | Health insurance | Learning and development stipend | Paid parental leave | Paid time off

Mid-level Full Time

Remote USA - In Tandem R

19d ago

Software Engineer Graduate (Inference Infrastructure) - 2026 Start (PhD) USD 156K-316K

C++ | Cloud Native | Container Orchestration | Deep learning | Distributed Systems

Career growth | Open Source contribution | World Class Collaboration

Entry-level Full Time

San Jose, California, United States

19d ago

AI Computing Development Engineer, TensorRT and TensorRT-LLM AIGV CNY 240K-480K

C# | C++ | Computer Vision | Debugging | Deep learning

Senior-level Full Time

China, Shanghai

20d ago

Intern Engineer – RL Post-Training for LLMs CAD 58K-104K

Data Generation | Deep learning | DeepSpeed | Distributed Training | GRPO

Internship

Entry-level Internship

Vancouver, British Columbia, Canada

21d ago

Inference Intern USD 60K-142K

C++ | Collective communication | Compilers | Consensus Protocols | Consistency models

Daily meals | Direct mentorship | Housing support | Paid internship

Entry-level Internship

San Jose

23d ago

Senior Consultant Specialist (Model Hosting/Inference Optimization) CNY 144K-240K

AWQ | AWS | Batching | CPU architecture | CUDA

Senior-level Full Time

Guangzhou, Guangdong, China

25d ago

Inference Engineer USD 180K-250K

CUDA | Continuous batching | Distributed Systems | Generative Models | Machine Learning

401k | Commuter allowance | Dental insurance | Flexible PTO | Health insurance

Mid-level Full Time

*HQ - San Francisco, CA R

25d ago

Solution Architecture Intern, AI in Industry - 2026 CNY 50K-70K

Artificial Intelligence | Attention Mechanisms | Benchmarking | C++ | GEMM

Entry-level Full Time Internship

China, Beijing

26d ago

Senior Machine Learning Engineer (Inference Platform) USD 175K-225K

AWS | Alerting | CI/CD | Continuous batching | Data Processing

Senior-level Full Time

Remote - USA R

26d ago

Senior Solutions Architect, Gen AI USD 184K-287K

AWS | Agentic AI | Azure | Cloud platform | DevOps

Senior-level Full Time

US, CA, Remote, United States R

28d ago

Ai院-开源模型适配 & 技术布道 CNY 180K-264K

Debugging | Git | GitHub | Hugging Face | Inference

Mid-level Full Time

北京

28d ago

Senior Solutions Architect - Generative AI INR 2475K-4500K

Argo | CI/CD | CUDA | Evaluation | FedRAMP

Senior-level Full Time

India, Pune

1mo ago

Engineering Manager, Inference Benchmarking — AI Perf USD 224K-356K

DCGM | Distributed Systems | GPU Telemetry | GPU observability | Helm

Senior-level Full Time

US, CA, Santa Clara, United States

1mo ago

Product Manager - AI Inference & Model Serving USD 165K-275K

AI Inference | Artificial Intelligence | Autoscaling | Cache Management | Continuous batching

Conference attendance | Professional development | Stock options | Training | Workstation provided

Mid-level Full Time

Austin, TX, United States

1mo ago

Senior NLP/LLM Engineer PLN 237K-326K

BERT | DPO | Deep learning | Entity recognition | Fine Tuning

English lessons discount | Health benefits | Professional training reimbursement | Remote work | Vacation

Senior-level Full Time

Worldwide R

1mo ago

Software Engineer (Python, Kubernetes, AI/ML) USD 153K-258K

AI Inference | Autoscaling | Container Orchestration | Docker | GPU scheduling

Extra Paid Sick Leave | Extra paid vacation | Flexible working hours | Language courses | Modern office amenities

Senior-level Full Time

Poland, Serbia, Cyprus, Georgia R

1mo ago

Machine Learning Ops Lead - VP SGD 165K-191K

AWS | AWS Lambda | AWS SageMaker | Amazon CloudWatch | Amazon ECR

Senior-level Full Time

SGP-Head Office, Singapore

1mo ago

Intern, AI Engineering USD 64K-106K

CUDA | CUDA kernel | CUDA kernel development | Hugging Face | Inference Optimization

Entry-level Internship

San Francisco, California

1mo ago

Senior, ML Engineer - Auto Tagger USD 177K-212K

AWS | Apache Arrow | Apache Beam | Apache Spark | Cloud platform

401k match | Company holiday office closures | Company-paid medical, dental & vision | Disability insurance | Flexible schedule

Senior-level Full Time

Ann Arbor, MI, Remote - US R

1mo ago

Product Manager - AI Inference & Model Serving USD 160K-275K

AI Inference | Autoscaling | Cache Management | Cold Start | Cold Start Optimization

Conference attendance | Professional development and training | Stock options | Workstation provided

Mid-level Full Time

Austin, TX, United States

1mo ago

Associate Director, Software Engineering (Model Hosting/Inference Optimisation) CNY 240K-360K

AWQ | AWS | Accelerate | Azure | Batching

Mid-level Full Time

Shenzhen, Guangdong, China R

1mo ago

Find jobs in AI/ML, Data Science and Big Data