38 jobs for LLM serving

Machine Learning Platform Engineer EUR 22K

Alerting | Data Pipelines | Distributed Systems | GPU Performance | Inference

Mid-level Full Time

Ireland R

6h ago

Staff Software Engineer AI/ML USD 163K-253K

A/B | A/B Testing | Autogen | B testing | Batched Inference

401k | Adoption support | Charitable giving match | Fertility care stipend | Flexible work environment

Senior-level Full Time

San Jose, California, United States

7h ago

Senior Software Engineer, Machine Learning Infrastructure (Tinder LLC, West Hollywood, California) USD 190K-246K

A/B | A/B Testing | AWS | Amazon ECS | Amazon EKS

Domestic travel up to 10 percent | On site meetings and trainings | Telecommuting permitted

Senior-level Full Time

West Hollywood, California

3d ago

IN_Senior Associate_Gen AI_Data and Analytics_Advisory_Bangalore INR 2500K-5000K

AWS Bedrock | Amazon RDS | Amazon SageMaker | Amazon Web Services | Aurora

Flexibility programmes | Inclusive benefits | Mentorship

Senior-level Full Time

Bengaluru Millenia, India

5d ago

IN_Senior Associate_Gen AI_Data and Analytics_Advisory_Bangalore INR 2500K-5000K

AWS Bedrock | Amazon SageMaker | Aurora | Azure AI | Cloud BigQuery

Senior-level Full Time

Bengaluru Millenia, India

5d ago

Staff Python / PyTorch Developer — Frontend Inference Compiler – Dubai USD 175K-266K

Automated testing | C++ | Deep learning | Distributed Systems | High Throughput

Job stability | Non-corporate work culture | Open source publishing | Startup vitality

Senior-level Full Time

UAE

6d ago

Engineering Manager, Deep Learning Inference USD 184K-287K

Agile | C# | C++ | CUDA | Cutlass

Mid-level Full Time

US, CA, Santa Clara R

6d ago

Senior Forward Deployed Engineer I (AI Inference) INR 3600K-4580K

AI Inference | Continuous batching | Data parallelism | Distributed Systems | FP4

Conference reimbursement | Employee assistance program | Flexible time off | LinkedIn Learning access | Local Employee Meetups

Senior-level Full Time

Bengaluru

7d ago

Staff Software Engineer, AI Reliability USD 325K-485K

API infrastructure | Chaos Engineering | Cloud infrastructure | Disaster Recovery | Distributed Systems

Competitive benefits | Flexible working hours | Generous vacation leave | Hybrid work option | Optional equity donation matching

Senior-level Full Time

San Francisco, CA | New York … R

7d ago

Multimodal LLM Algorithm Engineer Intern (Global E-Commerce, Knowledge Graph) - 2027 Start (PhD) SGD 57K-60K

Adversarial Networks | Agent planning | Anomaly Detection | Clustering | Computer Vision

Community building events | Hands-on learning | Professional development events

Entry-level Internship

Singapore

7d ago

Multimodal LLM Algorithm Engineer Intern (Global E-Commerce, Knowledge Graph) - 2027 Start SGD 40K-52K

Adversarial Networks | Agent planning | Clustering | Computer Vision | ControlNet

Career development workshops | Hands-on experience | Industry exposure | Learning programs | Social events

Entry-level Internship

Singapore

7d ago

Multimodal LLM Algorithm Engineer Graduate (Global E-Commerce, Knowledge Graph) - 2027 Start SGD 57K-60K

Agent planning | Anomaly Detection | Clustering | Computer Vision | ControlNet

Entry-level Full Time

Singapore

7d ago

AI Platform Engineer USD 130K-180K

API Gateways | AWS | Alerting | Authentication | Authorization

Senior-level Full Time

United States - Remote R

8d ago

Sr Machine Learning Engineer INR 3000K-4800K

AWS | Apache Kafka | Apache Spark | CI/CD | Confluence

Senior-level Full Time

India - Hyderabad

8d ago

Principal Data Architect and Manager - Service Special Projects USD 150K-205K

AWS Glue | AWS Glue Catalog | AWS S3 | Apache Atlas | Apache Flink

Senior-level Full Time

Cupertino

10d ago

Senior/Staff AI Engineer USD 152K-209K

CPU | Distributed Systems | GPU | High Performance | High-Performance Computing

Senior-level Full Time

Remote - California R

10d ago

[Lta-Tro] Ai System Architect — Transport Ai Programme SGD 120K-144K

API Design | Agentic Workflows | Architecture | Automated evaluations | Cloud Native

Senior-level Full Time

LTA ITSC L4, Singapore

11d ago

IN_Sr Associate_GEN / Agentic AI Engineer _D&A_Advisory_Gurgaon INR 3000K-5500K

A/B | A/B Testing | B testing | CI/CD | CloudFormation

Senior-level Full Time

Gurugram 10 C, India

11d ago

AI Engineer CAD 90K-140K

A/B | A/B Testing | AWS Athena | AWS Bedrock | AWS Lambda

Care days | Charitable giving program | Collaborative team environment | Flexible work arrangement | Hybrid work flexibility

Senior-level Full Time

Sun Life Toronto One York, Canada

12d ago

AI Engineer CAD 90K-140K

A/B | A/B Testing | Agent systems | Anomaly Detection | B testing

Senior-level Full Time

Sun Life Toronto One York, Canada

12d ago

Machine Learning/ Search Engineer - Services Special Projects USD 190K-285K

AWS | Apache Kafka | Batching | C++ | Cassandra

Senior-level Full Time

Cupertino

12d ago

Senior Software Engineer - AI Platform USD 144K-236K

Apache Beam | C# | C++ | CUDA | CUDA optimization

Health and wellness programs | Time off

Senior-level Full Time

Mountain View, CA, United States

14d ago

Machine Learning Software Engineer (Match Group AI) KRW 44000K-44000K

Apache Flink | Apache Kafka | Apache Spark | Batch Processing | C#

Mid-level Full Time

Seoul, South Korea

15d ago

AI Infrastructure Engineer, Serving Platform GBP 70K-81K

AWS | C++ | Docker | GCP | Go

Mid-level Full Time

London, UK

18d ago

Senior Engineer, Inference Data Plane USD 139K-174K

Continuous batching | Data parallelism | Distributed Systems | GRPC | Go

Employee assistance program | Employee stock purchase program | Equity compensation | Flexible time off | LinkedIn Learning access

Senior-level Full Time

Denver R

18d ago

Software Engineer - Platform & Application USD 175K-315K

API serving | AWS | Agent Frameworks | Apache Airflow | Apache Flink

Collaborative team environment | Mentorship | Production responsibility

Mid-level Full Time

Santa Clara HQ

19d ago

Senior/Staff Software Engineer - Machine Learning Platform (Inference) USD 236K-339K

Batch ML serving | DPO | Deep learning | Fine Tuning | Inference

Senior-level Full Time

US-CA-Menlo Park

19d ago

Software Engineer - TikTok AI Search Infrastructure USD 212K-389K

Algorithm Design | C++ | DAG | Data Architecture | Data Processing

Senior-level Full Time

San Jose, California, United States

20d ago

Applied Scientist, GenAI Catalog Intelligence, PRISM USD 171K-222K

Agentic Architectures | C++ | Confidence estimation | Deep learning | Experimental Design

Senior-level Full Time

Sunnyvale, California, USA

21d ago

Senior Inference Runtime Engineer TWD 1900K-2500K

CUDA | CUDA profiling | Continuous batching | Distributed inference | GPU Memory Optimization

Flexible work culture | Inclusive environment | Training and mentoring

Senior-level Full Time

Singapore, SG / Penang, MY / …

22d ago

Principal Machine Learning Engineer SGD 165K-245K

Containerization | Distributed Training | Fine Tuning | GPUs | High Performance

Birthday leave | Customizable benefits package | Employee assistance programme | FlexWork | Medical insurance

Senior-level Full Time

Singapore, Singapore

25d ago

Senior Staff Engineer, GDC AI Inference Platform USD 262K-365K

Agent coordination | C++ | Cloud infrastructure | Containerization | Data Structures

Bonus | Equity | Health insurance | Paid time off | Retirement plans

Senior-level Full Time

Sunnyvale, CA, USA; Kirkland, WA, USA

27d ago

Senior Machine Learning Engineer, Agentic Systems - Moveworks USD 161K-274K

C++ | Deep learning | Distributed Training | ETL Pipelines | Go

Senior-level Full Time

Mountain View, CALIFORNIA, United States

27d ago

Engineering Manager, DSC AI Inference Platform USD 207K-301K

Benchmarking | C++ | Continuous batching | Disaggregated serving | Distributed Computing

Bonus | Equity | Health benefits | Paid time off | Retirement plan

Senior-level Full Time

Sunnyvale, CA, USA

28d ago

Systems Research Engineer GBP 74K-121K

AI infrastructure | C++ | Data Locality | Distributed Systems | Fault Tolerance

None Full Time

Edinburgh, United Kingdom

29d ago

Applied AI Engineer

Cost Optimization | Data Preprocessing | Go | Hugging Face | Information Retrieval

Research publication opportunity

Senior-level Full Time

Gangnam District, Seoul

1mo ago

MaaS 架构师 CNY 240K-480K

Attention | Batching | C++ | CUDA | Continuous batching

Senior-level Full Time

上海、北京

1mo ago

Principal Engineer, Cloud Data Infrastructure USD 198K-323K

AI Engineering | Business Continuity | Business Continuity Planning | Caching | Cloud Computing

Financial security support | Healthcare coverage | Mental health resources | Paid time off

Senior-level Full Time

USA - California - San Jose …

1mo ago

Find jobs in AI/ML, Data Science and Big Data