85 jobs for Inference Server

Senior/Staff Software Engineer, GenAI Infrastructure PLN 364K-374K

API Gateway | BigQuery | Cloud Storage | Cloud platform | Data pipeline

Senior-level Full Time

Warsaw, Poland

1d ago

Staff Machine Learning Engineer, ML Infrastructure - Online CNY 360K-600K

A/B | A/B Experimentation | Autoscaling | Caching | Canary testing

Commute subsidy | Disability insurance | Employee stock ownership | Generous vacation | Health insurance

Senior-level Full Time

Shanghai, China

1d ago

Senior Machine Learning Engineer, ML Infrastructure - Online CNY 360K-600K

A/B | A/B Testing | Autoscaling | B testing | Canary testing

Commute subsidy | Competitive retirement pension plans | Employee resource groups | Employee stock ownership | Generous vacation

Senior-level Full Time

Shanghai, China

1d ago

Platform Support Architect USD 175K-200K

CI/CD | CUDA | Canary Deployment | Ceph | Ceph RBD

Senior-level Full Time

San Francisco - Remote, CA, United … R

1d ago

#Hiring | Senior Security Architect | Post-Quantum Cryptography (PQC) | AI/LLM Security | Frisco, TX (Onsite) USD 167K-246K

Backstage IDP | Confidential Computing | Confidential Computing TEE | Cryptography Agility | EBPF

Senior-level Contract Full Time

Frisco, TX, United States

1d ago

Senior Site Reliability Engineer (Noida, BLR, India) INR 3000K-5000K

CI/CD | Cast AI | FinOps | GCP | GPU Profiling

Senior-level Full Time

Noida

2d ago

Senior Machine Learning Operations Engineer II (AI Native) USD 148K-216K

AWS | Airflow | Apache Spark | Azure Synapse | Azure Synapse Analytics

401k matching | Disability insurance | Employee assistance program | Life insurance | Medical/Dental/Vision insurance

Mid-level Full Time

Remote, USA ; Remote, Canada R

4d ago

Lead AI Engineer INR 3000K-5000K

AWS | Agent Framework | Arize Phoenix | Autogen | Azure

Senior-level Full Time

Gurugram, Haryana, India

5d ago

AI Engineer - Agentic INR 2000K-3500K

AWS | Arize Phoenix | Async Programming | Autogen | Azure

Senior-level Full Time

Gurugram, Haryana, India

5d ago

Machine Learning Engineer EUR 67K-90K

AWS EC2 | AWS EKS | Airflow | Amazon SageMaker | CI/CD

Learning and development budget | Paid time off | Volunteer days

Senior-level Contract Full Time

Berlin

5d ago

Machine Learning Engineer EUR 70K-91K

AWS EC2 | AWS EKS | Airflow | Amazon SageMaker | CI/CD

Gym pass | Health coverage | Hybrid work | Learning budget | Lunch vouchers

Senior-level Contract Full Time

Paris R

5d ago

AI Development Specialist - Central & West Regions USD 150K-180K

AI Workbench | AI-assisted coding | Amazon Q | Amazon Q Developer | Application Acceleration

401(k) plan matching | Bereavement | Dental and vision care | Employee assistance program | Employee discount program

Senior-level Full Time

Phoenix, AZ, United States

6d ago

AI Development Specialist - East Region USD 150K-180K

AI Workbench | AI-assisted coding | Adoption and change management | Amazon Q | Amazon Q Developer

401k plan with company matching | Bereavement | Employee assistance program | Employee discount program | Health and wellbeing

Senior-level Full Time

Hartford, CT, United States

6d ago

AI Engineer INR 2500K-5000K

AWQ | Air-gapped | Autogen | C++ | Docker

Senior-level Full Time

IN-KA-Bangalore

8d ago

AI Engineer INR 2500K-5000K

AWQ | Air-gapped | Autogen | C++ | CUDA

Senior-level Full Time

IN-KA-Bangalore

8d ago

AI Engineer INR 2500K-5000K

AWQ | Access Control | Air Gapped Computing | Air-gapped | Autogen

Senior-level Full Time

IN-KA-Bangalore

8d ago

AI Engineer INR 2500K-5000K

AWQ | Autogen | C++ | CI/CD | CUDA

Senior-level Full Time

IN-KA-Bangalore

8d ago

AI Engineer INR 2500K-5000K

AWQ | Autogen | C++ | CUDA | Docker

Senior-level Full Time

IN-KA-Bangalore

8d ago

Staff Software Engineer, Deep Learning Acceleration USD 189K-274K

C++ | CUDA | Computer Vision | Deep learning | GPU Memory Optimization

Annual bonus | Benefits | Equity compensation | Hybrid work environment

Senior-level Full Time

San Francisco, California

8d ago

Staff Software Engineer, Deep Learning Acceleration USD 189K-274K

C++ | CUDA | Computer Vision | GPU Memory Optimization | GPU memory

Hybrid work environment

Senior-level Full Time

Mountain View, California

8d ago

Senior AI Architect, Foundation Models and SoC Co-Design – Autonomous Vehicles USD 208K-327K

Artificial Intelligence | Bottleneck analysis | CUDA | Deep learning | Diffusion Models

Benefits | Equity

Senior-level Full Time

US, CA, Santa Clara, United States

9d ago

Principal Data Engineer INR 3000K-3880K

AWS | Airflow | Apache Flink | Avro | Azure

Senior-level Full Time

Bangalore, IN

9d ago

AI Engineer (m/w/d) EUR 60K-75K

AI Foundry | AWS Bedrock | Agent systems | Agent workflows | Azure AI

Childcare support | Discounted Public Transit | Employee discounts | Flexible work schedule | Health and wellness benefits

Mid-level Full Time

Frankfurt am Main

10d ago

Principal Machine Learning Engineer, General AI, ML & Big Data A CAD 140K-200K

AWS | Asynchronous programming | Azure | CI/CD | Distributed Systems

Family leave | Health care plan | Life insurance | Paid time off | Training and development

Senior-level Full Time

Montreal, Quebec, Canada

12d ago

Helix AI Engineer, Backend Infrastructure USD 150K-400K

AWS | Alerting | Azure | C++ | CI/CD

Senior-level Full Time

San Jose, CA

12d ago

Machine Learning Systems Engineer USD 180K-250K

AWS | Alerting | Amazon SQS | Amazon SageMaker | Approximate Nearest Neighbor

Flexible work location | Remote work

Senior-level Full Time

Remote job R

12d ago

Machine Learning Systems Engineer USD 180K-250K

AWS | Alerting | Amazon SQS | Amazon SageMaker | Apache Kafka

Remote work

Senior-level Full Time

Remote job R

12d ago

Machine Learning Systems Engineer USD 180K-250K

AWS | Alerting | Amazon SageMaker | Asynchronous processing | Azure

Mentorship | Remote work

Senior-level Full Time

Remote job R

12d ago

Machine Learning Systems Engineer USD 180K-250K

AWS | Amazon SQS | Amazon SageMaker | Autoscaling | Azure

Flexible work environment | Professional growth | Remote work

Senior-level Full Time

Remote job R

12d ago

Product Manager - AI Inference & Model Serving USD 165K-275K

AI Inference | Artificial Intelligence | Autoscaling | Cache Management | Continuous batching

Conference attendance | Professional development | Stock options | Training | Workstation provided

Mid-level Full Time

Austin, TX, United States

14d ago

Senior ML Engineer USD 152K-228K

Amazon SageMaker | Baseten | Batching | CI/CD | Google Vertex

401k matching | Dental insurance | Fertility assistance | Flexible time off | Health insurance

Senior-level Full Time

Remote - US & Canada (see … R

18d ago

Gen AI - Engineering Lead INR 3000K-5000K

AI Stack | Agent systems | Agentic AI | Autonomous Agents | CUDA

Senior-level Full Time

Noida, Uttar Pradesh, India

19d ago

AI工程师-Agent Infra & LLMOps 方向（成都） CNY 180K-360K

Access Control | AutoGPT | CPU isolation | Docker | Firecracker

None Full Time

成都

19d ago

AI工程师-Agent Infra & LLMOps 方向（武汉） CNY 180K-360K

AutoGPT | Docker | Firecracker | GRPC | GVisor

Entry-level Full Time

武汉

19d ago

AI工程师-Agent Infra & LLMOps 方向（北京） CNY 180K-360K

AutoGPT | Docker | Firecracker | GRPC | GVisor

Entry-level Full Time

北京

19d ago

AI Engineer - Bees Personalization BRL 264K-316K

AI Foundry | AWS | Azure | Azure AI | Azure AI Foundry

Casual office dress code | Childcare subsidies | Dental insurance | Discounts on Ambev products | Health insurance

Mid-level Full Time

Campinas, São Paulo, Brazil

19d ago

Solution Architect, Computer Vision – Media and Entertainment EUR 55K-72K

3D Rendering | Cloud Computing | Computer Vision | Containerization | DeepStream

Senior-level Full Time

France, Courbevoie

20d ago

Machine Learning Operations Engineer (w/m/d) EUR 47K-47K

Batching | CUDA | Docker | FP16 | FP32

Additional location-based benefits | Company pension scheme | Conference participation | Flexible working hours | Home office

Entry-level Full Time

Eschborn, DE, 65760

20d ago

Product Manager - AI Inference & Model Serving USD 160K-275K

AI Inference | Autoscaling | Cache Management | Cold Start | Cold Start Optimization

Conference attendance | Professional development and training | Stock options | Workstation provided

Mid-level Full Time

Austin, TX, United States

20d ago

Forward Deployed Engineer (Machine Learning)

Computer Vision | Deep learning | Docker | GPU Computing | Inference Server

Active lifestyle reimbursement | Continuous learning bonus | Health care reimbursement | Home office reimbursement | Paid time off

Mid-level Full Time

Mexico - Remote R

21d ago

Sr GenAI Infra Specialist SA, AWS WWSO Startup USD 153K-228K

AWS | Amazon EC2 | Amazon EKS | Amazon S3 | Cache optimization

Inclusive team culture | Mentorship and career growth | Work-life balance

Senior-level Full Time

New York, New York, USA

21d ago

Machine Learning Intern - 2026

Deep learning | Inference Server | Linux | Machine Learning | NVIDIA GPU

Entry-level Full Time Internship

Hong Kong, STP

21d ago

AI Platform & Inference Suite Engineer (Staff/Senior Staff level) - Riyadh, KSA USD 151K-227K

C# | C++ | Capacity Planning | Concurrency | Container Orchestration

Customer facing technical advisory role | Technical documentation and training opportunities | Travel opportunities

Senior-level Full Time

Riyadh, Saudi Arabia

21d ago

Manager, ML Engineering INR 2000K-2800K

AWS Bedrock | AWS SageMaker | Agent Orchestration | Agentic Workflows | Amazon EKS

AI productivity tools support | Hybrid work environment | On site 3 days per week

Mid-level Full Time

Bangalore

21d ago

Forward Deployment Engineer - Gen AI USD 162K-224K

AWS Bedrock | AWS SageMaker | Autogen | Azure OpenAI | Chroma

Career development opportunities | Individual responsibility | Travel to client sites

Mid-level Full Time

New York, New York, United States

22d ago

Senior Software Engineer (Machine Learning )

A/B | A/B Testing | Apache Spark | B testing | CI/CD

Full-time | Remote work

Senior-level Contract

Colombia - Remote R

22d ago

Staff Engineer USD 191K-239K

AMD GPU | Apache Yunikorn | Autoscaling | Bin packing | CRIU

Conference reimbursement | Education reimbursement | Employee assistance program | Employee stock purchase program | Equity compensation

Senior-level Full Time

Seattle

22d ago

Lead AI Engineer USD 180K-280K

CI/CD | ColBERT | Docker | Faiss | Fine Tuning

401k match | Bonus | Childcare benefits | Dental insurance | Disability insurance

Senior-level Full Time

Quincy, MA, United States

22d ago

AI SW Stack Deployment Architect INR 2500K-4500K

API Design | Cloud Computing | Distributed Systems | Edge Computing | Inference Server

Senior-level Full Time

Bengaluru, KA, India

23d ago

Forward Deployed Engineer (Generative AI) USD 153K-222K

AWS Bedrock | Amazon SageMaker | Autogen | Azure OpenAI | Chroma

Career development | High individual responsibility | Travel to client sites

Senior-level Full Time

United States - Remote R

23d ago

Find jobs in AI/ML, Data Science and Big Data