318 jobs for LLM Evaluation

Senior Machine Learning Platform Engineer USD 155K-215K

AI Observability | AWS SageMaker | Alerting | Amazon ECS | Audio Processing

On-call rotation

Senior-level Full Time

New York, NY

1d ago

Data & Analytics Engineer - AI Platform team (Hybrid) EUR 56K-88K

CAG | DBT | Data Modeling | Elasticsearch | Grafana

Employee discounts | Employee events | Flexible working hours | Free drinks | Health offers

Senior-level Full Time

Hinterm Hauptbahnhof 3-5, 76137 Karlsruhe R

1d ago

AI Researcher INR 2000K-3500K

Algorithmic Fairness | Bias Audit | Data Annotation | Dataset Building | Educational measurement

Mid-level Full Time

Hybrid in Bangalore, India R

1d ago

Research Scientist, LLM Evaluation & Post-Training USD 150K-300K

AI Feedback | Alignment | Benchmarking | Context evaluation | Deep learning

Mid-level Full Time

Remote Work( USA), United States R

1d ago

Full Stack Developer :: Acon INR 2500K-4500K

AI Search | AI Studio | Agentic RAG | Application Security | Arize Phoenix

Senior-level Full Time

India

2d ago

Principal AI Engineer CNY 360K-600K

Authentication | Authorization | CI/CD | Docker | FastAPI

Senior-level Full Time

China

2d ago

Senior Data Engineer - AI Platform EUR 56K-79K

API Design | Audit Logging | Authentication | Authorization | BigQuery

Hybrid work | Open source contributions | Training and certification

Senior-level Full Time

Málaga

2d ago

Senior Data Engineer - AI Platform EUR 56K-79K

API Design | Audit Logging | Authentication | Authorization | BigQuery

Hybrid work model | Open Source friendly | Training and certification

Senior-level Full Time

Madrid

2d ago

Data Scientist INR 2211K-4000K

Agentic Workflows | Csharp | Java | JavaScript | LLM Evaluation

Senior-level Full Time

India - Bangalore

2d ago

Senior Data Scientist USD 119K-261K

Classifier Training | Data Mining | LLM Evaluation | LLM-as-a-Judge | Language Models

Senior-level Full Time

Redmond, WA, US; Mountain View, CA, …

3d ago

Senior AI Engineer USD 150K-200K

AWS | CI/CD | EKS | Express.js | GitHub Actions

Onsite work opportunity

Senior-level Full Time

Calabasas, CA

3d ago

AI Solution Architect USD 117K-165K

API Integration | Access Management | Agent Orchestration | Agent evaluation | Agent systems

Employee assistance program | Employee resource groups | Flexible time off | Medical insurance plans | Mentorship

Senior-level Full Time

Escazú, San José, Costa Rica

3d ago

Machine Learning Engineer, PhD Intern (Fall) USD 100K-125K

Algorithms | Data Management | Distillation | Feedback learning | Generative AI

Remote work flexibility

Entry-level Internship

United States - Remote R

3d ago

Senior AI Engineer (All Genders) PLN 246K-400K

AI Safety | API Design | API Testing | Amazon Bedrock | Automated testing

Bike leasing | Discount on products | Hybrid working | Option to work abroad | Subsidised transport

Senior-level Full Time

Krakow, Poland

3d ago

[Growth Engineering] Staff Back-end Engineer I CNY 144K-240K

Anomaly Detection | CI/CD | Containerization | FastAPI | Graph Database

Senior-level Full Time

Shanghai, China

3d ago

[Growth Engineering] Staff Back-end Engineer I CNY 144K-240K

CI/CD | Containerization | FastAPI | Graph Database | Inference Server

Senior-level Full Time

Shanghai, China

3d ago

Applied AI Engineer USD 175K-250K

Agent Frameworks | Artificial Intelligence | Clustering | Embeddings | Fine Tuning

Mid-level Full Time

Sapien HQ — NYC

3d ago

Agentic AI Engineer INR 3000K-5000K

AWS | Access Control | Autogen | Azure | CI/CD

Senior-level Full Time

Gurugram, Haryana, India

3d ago

AI Engineer USD 125K-201K

AWS | Agent Frameworks | Agent SDK | Agent coordination | Claude Agent SDK

Collaboration with little supervision | Startup environment | Work on cutting-edge AI

Entry-level Full Time

Pittsburgh, Pennsylvania, United States

3d ago

Sr. Staff, Data Science & Applied AI INR 2475K-5000K

API Gateway | AWS Bedrock | AWS Bedrock Agents | AWS Lambda | AWS Step Functions

Senior-level Full Time

Hyderabad - Phoenix Equinox Tower 2, …

3d ago

Machine Learning Engineer INR 1500K-2500K

AWS | Asynchronous processing | Azure | CI/CD | Containerization

Flexible work environment | Hybrid work

Mid-level Full Time

Mumbai, India

3d ago

AI Test Engineer - Senior Manager INR 3000K-5000K

AI Foundry | API Testing | AWS Bedrock | Adversarial Testing | Azure AI

Senior-level Full Time

Karnataka, India

3d ago

Actuarial and Data Science Model Validation - AI/Gen AI USD 108K-162K

Agent Development Kit | Context engineering | Generative AI | Google Agent Development Kit | Huggingface

Mid-level Full Time

Hartford CT- Home Office, United States

3d ago

Agentic AI Developer

A2A | API Integration | Fallbacks | LLM Evaluation | Langgraph

Entry-level Full Time

Bogota, Carrera 7, Colombia

3d ago

APTPUO-Winter 2027-DTI6302D (topic; Prompt Engineering) CAD 478K-478K

AI Foundry | AI Safety | AI reliability | Agentic AI | Azure AI

Curriculum development | Professional training | Teaching experience

Mid-level Part Time

200 Lees Block E, Canada

3d ago

AI/ML Engineer USD 86K-198K

API Integration | AWS | Azure | Cloud Computing | Deep learning

Dependent care | Paid leave | Professional development | Tuition assistance | Work-life programs

Mid-level Full Time

USA, VA, Arlington (1550 Wilson Blvd), …

3d ago

Agentic AI Machine Learning Engineer USD 99K-225K

API Integration | AWS | Artificial Intelligence | Azure | Confluent

Dependent care | Health insurance | Paid leave | Professional development | Remote work options

Mid-level Full Time

USA, DC, Washington (901 15th St …

3d ago

Staff Applied AI Scientist AUD 148K-180K

Agentic Systems | Data labeling | Human-in-the-loop | LLM Evaluation | LLM-as-a-Judge

Extended end of year break | Home workspace setup budget | Inclusive parental leave | Learning programs and coaching | MacBook provision

Senior-level Full Time

Sydney

4d ago

Lead Software Engineer - AI Developer USD 175K-195K

API Gateway | AWS Bedrock | AWS Lambda | AWS Step Functions | Amazon ECS

Senior-level Full Time

Plano, TX, United States

4d ago

Lead Software Engineer - AI Developer USD 175K-195K

API Gateway | AWS Step Functions | Amazon Bedrock | Amazon DynamoDB | Amazon ECS

Senior-level Full Time

Plano, TX, United States

4d ago

Internal Audit-Hyderabad-Associate-Data Analytics & Reporting INR 144K-192K

Access Control | Autogen | CI/CD | Chroma | Continuous Monitoring

Entry-level Full Time

Hyderabad, Telangana, India

4d ago

Senior Full-Stack Software Engineer, Applied AI A RON 295K-387K

A/B | A/B Testing | AI Agents | B testing | Experimentation

Annual company retreats | Fully remote | Home office setup stipend | Learning and development budget | Medical coverage

Senior-level Full Time

Romania R

4d ago

Senior Full-Stack Software Engineer, Applied AI A EUR 90K-130K

A/B | A/B Testing | AI Agents | B testing | Data Pipelines

Annual company retreats | Family support | Fully remote | Home office setup stipend | Learning and development budget

Senior-level Full Time

Spain R

4d ago

Generative AI Specialist / AI & ML Developer USD 135K-216K

A/B | A/B Testing | AI Safety | AWS | Agent Orchestration

Remote work | Security clearance support | Technical demonstrations | Travel for OCONUS as needed

Mid-level Full Time

United States

4d ago

Applied AI Architect JPY 8600K-9700K

Claude API | Cloud Architecture | Data Science | Enterprise Integration | LLM Evaluation

Flexible working hours | Generous vacation | Parental leave | Visa sponsorship

Senior-level Full Time

Tokyo, Japan

4d ago

Lead Engineer INR 2500K-4800K

AI Platform | Agile | Automation | Cloud Computing | Code generation

Accident insurance | Certification sponsorship | Childcare assistance reimbursement | Employee assistance program | Flexible leave policy

Senior-level Full Time

Bangalore, Velankani Tech Park, India

4d ago

Core Data -AI Enablement Engineer - Assistant Manager INR 2500K-4500K

AI Search | AI evaluation SDK | Azure AI | Azure AI Evaluation | Azure AI Evaluation SDK

Employee networks | Flexible work/life support | Inclusive development opportunities | Paid volunteer days

Senior-level Full Time

Bangalore, India

4d ago

Sr Machine Learning Engineer INR 2000K-4000K

AI Observability | AWS | Agentic Workflows | Amazon Bedrock | Apache Kafka

Senior-level Full Time

India - Hyderabad

4d ago

Senior Software Engineer INR 3000K-5000K

A/B | A/B Testing | AI Search | Async Programming | B testing

Senior-level Full Time

DGS India - Mumbai - Thane …

4d ago

Praktikant*in für KI-Evaluation für LLM-basierte Systeme im Bereich Daten und KI Research & Development EUR 38K-38K

Bias detection | Calibration | Dashboards | Data Pipelines | Data Visualization

Barrier free access | Canteen cafe | Child care | Coaching | Company doctor

Entry-level Internship

Sindelfingen, DE

4d ago

Senior Recruiter – Applied Science, Machine Learning & Data Science Recruiting USD 94K-155K

Candidate engagement | Compensation benchmarking | Computer Vision | Deep learning | Full-cycle recruiting

Senior-level Full Time

California - San Francisco, United States

4d ago

Principal AI Engineer USD 97K-189K

Agent Orchestration | Artifact management | C++ | CI/CD | Code Analysis

Senior-level Full Time

US- IL40- Chicago-151N Frankln, United States

4d ago

Intern Engineer – RL Post-Training for LLMs CAD 58K-104K

Data Generation | Deep learning | DeepSpeed | Distributed Training | GRPO

Internship

Entry-level Internship

Vancouver, British Columbia, Canada

5d ago

Tech Lead Gen AI INR 2500K-4000K

AI vector search | Arize AI | Cloud Monitoring | Cloud Run | Cloud platform

Access to training and industry experts | Hybrid work options | International mobility | Learning and development | Professional development programs

Senior-level Full Time

Bengaluru

5d ago

AI Senior Software Engineer INR 1800K-3300K

Agent collaboration | Agents SDK | Autogen | CI/CD | Embeddings

Inclusive work environment

Senior-level Full Time

Noida, Uttar Pradesh, India

5d ago

LLM Team Lead

APIs | Agents | CI/CD | Cloud Native | Distributed Systems

Senior-level Full Time

Netanya, Center District, IL

5d ago

Data Scientist Senior USD 114K-218K

Airflow | Anomaly Detection | C++ | CI/CD | CNN

401k | Adoption Assistance | Continuing education | Hybrid flexibility | Life insurance

Senior-level Full Time

Plano Legacy, United States

5d ago

AI Engineer USD 134K-241K

APIs | Agentic Workflows | Autogen | CrewAI | Data handling

Ability to obtain TS/SCI clearance | Active secret clearance

Senior-level Full Time

USA AL Redstone Arsenal (5224 Martin …

5d ago

Senior Principal AI Software Engineer - IT Go-To-Market & Customer Experience USD 223K-306K

Adversarial Training | Agent Orchestration | Agent systems | Arize | Generative AI

Senior-level Full Time

Santa Clara, CA

5d ago

Principal Data Scientist - Agent Builder GBP 97K-124K

A/B | A/B Testing | B testing | CI/CD | Context Enrichment

Financial donation matching | Flexible schedule | Health coverage | Parental leave | Vacation days

Senior-level Full Time

Greece; Ireland; Poland; Portugal; Spain; Sweden; …

6d ago

Find jobs in AI/ML, Data Science and Big Data