83 jobs for Inference Server

ML Operations Engineer (AI/LLM) - Mercari JPY 8600K-9700K

BigQuery | Bigtable | CI/CD | Docker | Drift Detection

Flexible work hours

Senior-level Full Time

Minato City, Tokyo, Japan

2d ago

AI Platform Engineer USD 130K-180K

API Gateway | AWS | Authentication | Authorization | Autoscaling

Career growth | Direct W2 employment | Remote work

Senior-level Full Time

United States - Remote R

2d ago

Senior Solutions Architect, Higher Education and Research - Open Models and LLM GBP 92K-173K

AI Enterprise | Agent Toolkit | Agentic Workflows | CPUs | CUDA

Conference support | Travel 30 Percent Time

Senior-level Full Time

Remote - UK R

2d ago

Software Engineer, Cloud Infrastructure (Multiple Seniority Levels) USD 135K-260K

AWS | AWS Batch | AWS CDK | Airflow | Amazon Bedrock

401k | PTO | Paid Holidays

Senior-level Full Time

San Carlos - Hybrid R

2d ago

Senior Software Engineer USD 151K-235K

Auto Scaling | Batch scheduling | C++ | CI/CD | Continuous batching

Flexible work location | Health and wellbeing resources | Paid volunteer days

Senior-level Full Time

Seattle - United States - Seattle, … R

3d ago

Research Scientist / Software Engineer, LLM/Agent Platform - TikTok - Content Ecology AI Innovation & Platform USD 160K-230K

Accelerator optimization | Deep learning | DeepSpeed | Distributed Systems | Evaluation Frameworks

Senior-level Full Time

San Jose, California, United States

3d ago

Embedded Perception Engineer USD 150K-185K

C++ | CLIP | CUDA | Computer Vision | Deep learning

401k matching | Dental insurance | Global Entry | Health and wellness stipend | Health insurance

Mid-level Full Time

Remote R

4d ago

Platform Lead - ML Ops GBP 80K-109K

AWS | Ansible | Autoscaling | Azure | Bash

Senior-level Full Time

London, United Kingdom

4d ago

Forward Deployed Engineer (Generative AI) USD 183K-265K

AI Pipelines | AI Studio | AI vector search | Autogen | Cloud SDK

Career development | Travel to client sites

Mid-level Full Time

United States - Remote R

5d ago

Integration Engineer - AI Pipelines GBP 65K-85K

AWS | CUDA | Computer Vision | Docker | Embeddings

Mid-level Full Time

London, UK

5d ago

Senior Technical Program Manager (TPM) – GenAI EUR 51K-70K

Concurrency optimization | Cost Optimization | GPU deployment | Generative AI | Inference Optimization

Senior-level Full Time

FI,Helsinki

6d ago

【Elite100】研發替代役_AI Architect(內湖) TWD 310K-490K

Autogen | Azure OpenAI | CUDA | CrewAI | Deep learning

Senior-level Full Time

Taipei Neihu, Taiwan

6d ago

AI Platform Engineer USD 130K-180K

API Gateway | AWS | Authentication | Authorization | Autoscaling

Senior-level Full Time

United States - Remote R

6d ago

CVP of Applied AI FDE USD 296K-442K

Artificial Intelligence | CUDA | Distributed Computing | Docker | Fine Tuning

Executive-level Full Time

US,CA,San Jose

6d ago

Machine Learning Infrastructure Engineer, Model Inference USD 221K-260K

API Development | Ansible | CUDA | Container Registry | Custom Resource Definitions

401k matching | Commuter benefits | Comprehensive medical, dental, vision | Flexible PTO | Flexible spending accounts

Mid-level Full Time

SF Office R

7d ago

数据Infra工程师 CNY 180K-360K

Apache Spark | Deep learning | Distributed Computing | FastAPI | Flask

Mid-level Full Time

北京

8d ago

数据Infra工程师 (流式) CNY 180K-300K

Apache Spark | Automated Data Labeling | Data labeling | Data pipeline | Deep learning

Mid-level Full Time

北京

8d ago

数据Infra工程师 (具身) CNY 180K-300K

Apache Spark | Deep learning | Distributed Systems | Error Handling | FastAPI

Mid-level Full Time

北京

8d ago

Senior Research Scientist/Software Engineer, LLM/Agent Platform (TikTok-Content Ecology AI Innovation & Platform) USD 160K-230K

CUDA | Deep learning | DeepSpeed ZeRO | Distributed Systems | Evaluation Frameworks

Senior-level Full Time

San Jose, California, United States

8d ago

Engr III Spec-AI Science INR 2500K-4800K

Algorithm performance | Algorithm performance tuning | Amazon SageMaker | Azure Machine Learning | BentoML

Senior-level Full Time

VDSI, 201 TITUS,. BLDG#10, Hyderabad, IND … R

9d ago

Senior Solutions Architect, Inference Service Providers USD 184K-287K

Agent Design | Cache Management | Custom Inference Kernels | Data Curation | DevOps

Senior-level Full Time

US, CA, Santa Clara R

9d ago

Lead AI Engineer USD 180K-280K

AWS SageMaker | Azure ML | CI/CD | ColBERT | Docker

401k match | Bonus | Childcare benefits | Dental insurance | Disability insurance

Senior-level Full Time

Quincy, MA, United States

9d ago

AI/ML Engineer III USD 125K-175K

AI Safety | AWS | Agentic Workflows | Asynchronous programming | Autogen

Senior-level Full Time

Utica-Rome NY Hybrid or Remote R

9d ago

Senior Member Technical Staff INR 3242K-4800K

API Development | AWS | Amazon SageMaker | CI/CD | Computer Vision

Autonomy | Mentorship opportunities | Remote-friendly work environment

Senior-level Full Time

Bengaluru, India

10d ago

Principal Data Scientist (Computer Vision)- 8+ years INR 3000K-5000K

A/B | A/B Testing | AWS Bedrock | Agent systems | Airflow

Senior-level Full Time

Bangalore, India

10d ago

Software Engineer 2 (Machine Learning) (TS/SCI with Poly) USD 275K-282K

Automated Speech Recognition | CI/CD | Computer Vision | Docker | Inference Server

401k | Employee discount program | Flexible work schedule | Health savings accounts | Life insurance

Senior-level Full Time

FORT MEADE, MD, US R

10d ago

Research Engineer / Scientist - Storage for LLM USD 162K-387K

Batching | C++ | CUDA | CUDA Networking | CUDA aware Networking

401k match | Conference attendance | Life insurance | Long-term disability | Medical/Dental/Vision insurance

Mid-level Full Time

San Jose, California, United States R

10d ago

Senior Research Engineer / Scientist - Storage for LLM USD 207K-368K

Autoregressive decoding | Batched decoding | C++ | CUDA | CUDA aware Networking

401k savings plan with company match | Conference attendance | Life insurance | Long-term disability | Medical/Dental/Vision insurance

Senior-level Full Time

Seattle, Washington, United States R

10d ago

Research Engineer / Scientist - Storage for LLM USD 153K-300K

Batching | C++ | CUDA | CUDA Networking | CUDA aware Networking

401k matching | Life insurance | Long-term disability | Medical, dental, and vision insurance | Paid Holidays

Mid-level Full Time

Seattle, Washington, United States R

10d ago

Senior Developer Relations Manager - FSI INR 3000K-5500K

AI Enterprise | CUDA | CUDA Nsight | Cloud Native | Data Engineering

Senior-level Full Time

India, Mumbai

11d ago

Senior Developer Relations Manager - Conglomerates INR 2500K-5000K

AI Enterprise | Application Architecture | CUDA | Cloud infrastructure | Data platform

Senior-level Full Time

India, Mumbai

11d ago

Developer Relations Manager, Higher Education and Research - Foundational AI CAD 170K-220K

Attention Optimization | CUDA | Data Generation | Deep learning | Distributed Training

Senior-level Full Time

Canada, Toronto

13d ago

AI Developer USD 111K-156K

CI/CD | Deep learning | Docker | Inference Server | LLM guardrails

Senior-level Full Time

Saudi Arabia - Remote R

13d ago

Senior MLOps Engineer II (AI Native) USD 148K-216K

AWS | Apache Airflow | Apache Ray | Apache Spark | Azure Storage

401k match | Employee assistance program | Health insurance | Mental wellness program | Paid parental leave

Mid-level Full Time

Remote, USA ; Remote, Canada R

15d ago

Senior Machine Learning Engineer BRL 304K-380K

Alerting | Azure Cloud | Azure DevOps | BentoML | Databricks

Casual office and dress code | Childcare subsidies | Days off | Dental insurance | Health insurance

Senior-level Full Time

Campinas, Brazil

15d ago

A/AI Machine Learning Engineering - E2 USD 91K-169K

C++ | CI/CD | CUDA | Cloud Computing | Data Curation

401k match | Dental insurance | EAP | Education assistance | Flexible spending accounts

Entry-level Full Time

Manassas, VA, US

16d ago

ML Ops Engineer GBP 80K-109K

AWS | Ansible | ArgoCD | Bash | Cloud platform

Senior-level Full Time

London, United Kingdom

17d ago

ML Ops Lead GBP 84K-120K

AWS | Ansible | Auto Scaling | Azure | Bash

Senior-level Full Time

London, United Kingdom

17d ago

Tech Lead — ASR / TTS / Speech LLM (IC + Mentor) SGD 60K-130K

AGC | Active Learning | Activity Detection | Automatic Speech Recognition | CTC

HIPAA compliant environment | Healthcare domain impact | Mentorship | SOC 2 aligned operations

Senior-level Full Time

Singapore R

17d ago

Senior Product Manager – AI Inference Performance USD 208K-327K

Artificial Intelligence | Benchmarking | Inference Optimization | Inference Server | KV cache

Senior-level Full Time

US, CA, Santa Clara

17d ago

Staff ML Scientist - PFI INR 4000K-5500K

AWS Lambda | AWS SageMaker | Amazon CloudWatch | Amazon EC2 | Amazon ECR

Hybrid work

Senior-level Full Time

Bengaluru, India R

18d ago

Machine Learning Engineer USD 100K-177K

AWS SageMaker | Apache Airflow | Average Precision | CNN | Classification

Mid-level Full Time

MA, US

18d ago

Machine Learning Engineer, Foundation Model Services USD 143K-264K

AWS | Azure | Cloud platform | DeepSpeed | Docker

Mid-level Full Time

Seattle

18d ago

Lead Machine Learning Engineer USD 157K-235K

Anyscale | Auto Scaling | C++ | CI/CD | CUDA

401k plan | Dental insurance | Disability benefits | Life insurance | Medical insurance

Senior-level Full Time

Burbank, CA, US, 91505

19d ago

GM - IT Analytics INR 2000K-5000K

Ansible | Apache Iceberg | CI/CD | Cloudera Data Platform | Data platform

Senior-level Full Time

Pune, Maharashtra, IN

19d ago

AI Inference Platform Engineer USD 130K-241K

C++ | CI/CD | Data Pipelines | Data Visualization | Distributed Systems

Senior-level Full Time

Seattle

19d ago

Machine Learning Engineer II USD 111K-231K

Apache Kafka | Apache Spark | Big Data | Cloud platform | Data pipeline

401k | Backup childcare | Education stipends | Health insurance | Hybrid work

Mid-level Full Time

US - United States of America R

20d ago

Senior Machine Learning Engineer BRL 319K-443K

Azure | Azure DevOps | BentoML | Databricks | Feature Store

Casual office dress code | Childcare subsidies | Days off | Dental insurance | Discounts on company products

Senior-level Full Time

Campinas, São Paulo, Brazil

22d ago

Staff ML - GenAI Engineer, Voice & Speech INR 3584K-4680K

API Development | AWS | Audio Alignment | Audio Processing | Cloud Computing

Flexible work hours | Overlap with India and US business hours | Remote work | Work from India

Senior-level Full Time

India R

24d ago

GEN AI Specialist CAD 90K-100K

AWS SageMaker | Azure AI | CUDA | ChromaDB | Clustering

Company-Paid Holidays | Disability insurance | Employee assistance program | Health insurance | Life insurance

Senior-level Full Time

Montreal, CA

24d ago

Find jobs in AI/ML, Data Science and Big Data