41 jobs for LLM Evaluation

Sr. Staff Enterprise AI Architect USD 132K-244K

ABAC | Agent observability | Autonomous Agents | CI/CD | Data masking

Flexible work arrangements

Senior-level Full Time

United States

18h ago

Senior Data Scientist - AI/ML Engineer USD 185K-250K

API Development | AWS | Adapter Training | Agentic AI | Cloud Native

Access to AI resources | Conference Presenting | Conference attendance | Learning budget | Team offsite

Senior-level Full Time

Sunnyvale Office

1d ago

Data Scientist - Agentic AI INR 1300K-1500K

AWS | Agent systems | Azure | Dataset Preprocessing | Enterprise Integration

Mid-level Full Time

Bangalore, KA, IN, 560066

1d ago

Client Director, Frontier Data - US USD 255K-325K

APIs | Automation | Data Annotation | Data Validation | Databricks

Collaborative culture | Five days a week work | Flexible working hours | Supportive work environment

Executive-level Full Time

Palo Alto, California, United States; San …

1d ago

Internal Systems Engineer (Applied AI) ZAR 240K-264K

Agentic Workflows | CI/CD | DAG | Freshdesk | JavaScript

Coursera subscription | Flexible working | Gym reimbursement | Internet allowance | Parental leave

Entry-level Full Time

Cape Town

1d ago

Research Engineer

Benchmarking | LLM Evaluation | Language Models | Large Language Models | Machine Learning

Mid-level Full Time

Tel Aviv-Yafo, Tel Aviv District, IL

1d ago

Solution Architect Graduate (BytePlus) - 2026 Start (BS/MS) - Vietnam USD 136K-250K

Caching | Context engineering | Docker | FastAPI | Generative AI

Entry-level Full Time

Ho Chi Minh City, Ho Chi …

1d ago

Senior Technical Program Manager II, Applied AI USD 240K-334K

AI Agents | Accuracy Metrics | Cross-functional | Cross-functional leadership | Customer interaction

Senior-level Full Time

Waterloo, ON, Canada; Cambridge, MA, USA

1d ago

Technical Program Manager II, AI/ML, Google Ads USD 138K-198K

Cross-functional | Cross-functional project management | Data analytics | LLM Evaluation | Language Models

Mid-level Full Time

New York, NY, USA

1d ago

Data Engineer SGD 57K-70K

Apache Hive | Apache Spark | Azure DevOps | Azure Machine Learning | CI/CD

Entry-level Full Time

Singapore, Singapore, Singapore

2d ago

Senior AI Engineer GBP 90K-125K

APIs | AWS | Agent workflows | Azure | Cost Optimization

Employee support and wellness | Hybrid work model | Professional development opportunities | Relocation support | Remote work flexibility

Senior-level Full Time

United Kingdom R

2d ago

Principal AI Engineer, Chatbot Development USD 223K-313K

A/B | A/B Testing | B testing | Compliance | Conversational AI

Education subsidy | Healthcare schemes | L D programs | Meal allowances | Team building programs

Senior-level Full Time

APAC

2d ago

AI Solutions Architect EUR 70K-80K

AI Governance | AI ethics | API Integration | Agent systems | Agentic AI

Senior-level Full Time

Office-wide

2d ago

Principal Staff Software Engineer, Machine Learning INR 1800K-4000K

A/B | A/B Testing | B testing | Backpressure Control | Caching

Health and wellness programs | Time away

Executive-level Full Time

Bengaluru, KA, India

2d ago

Applied AI Engineer – GenAI Systems CAD 94K-144K

APIs | Agent Orchestration | Anomaly Detection | Backtesting | CI/CD

Dental insurance | Disability insurance | Employee assistance program | Health insurance | Life insurance

Senior-level Full Time

CAN, Ontario, Toronto, 200 Bloor Street …

2d ago

Agentic AI Data Scientist USD 90K-135K

Agent workflow | Amazon Web Services | Chroma | Cloud platform | Generative AI

Hybrid work schedule | Remote work options

Mid-level Full Time

Hartford CT- Home Office, United States

2d ago

Senior Machine Learning Engineer USD 151K-265K

AI frameworks | Agentic AI | Context engineering | Deep learning | Fine Tuning

Senior-level Full Time

San Jose, United States

2d ago

Staff Applied AI Scientist USD 245K-321K

Agentic AI | Anthropic API | FastAPI | Human Feedback | Java

Hybrid work schedule

Senior-level Full Time

Denver, CO;San Francisco, CA;New York, NY;Los …

2d ago

Senior Software Engineer USD 120K-160K

AI SDK | AWS | Angular | CI/CD | Docker

401k match | Dental insurance | Disability insurance | Education assistance | FSA

Senior-level Full Time

Denver, CO; Field

2d ago

Data Scientist / Engineer USD 80K-110K

Anthropic API | Apache Spark | Azure | CrewAI | Csharp

Flexible remote and hybrid working options | Learning and development opportunities | Mental health benefits | Paid Holidays | Paid time off

Entry-level Full Time

US - Boston

2d ago

Staff Machine Learning Engineer - Content and Contributor Intelligence (Remote - United States) USD 112K-269K

AWS Bedrock | Automation | Batch Processing | C++ | Computer Vision

Career development | Collaborative team environment | Fully remote option | Mentorship

Senior-level Full Time

San Francisco, CA, United States R

3d ago

Senior Data Scientist USD 119K-258K

A B Testing Metrics | A/B | A/B Testing | B testing | Data Pipelines

Senior-level Full Time

Redmond, WA, US

3d ago

Senior Machine Learning Engineer INR 3200K-4600K

A/B | A/B Testing | AWS | Alerting | Azure

Hybrid work flexibility | On-site collaboration

Senior-level Full Time

India - Pune - Office

3d ago

Alternant ML Engineer IAGen F/H (DSI/FAB) EUR 46K-60K

AI Search | API Development | Azure AI | Azure AI Search | Chunking

Learning Support | Regular skills development | Team mentorship

Entry-level Full Time

RATP SIEGE SOCIAL LYBY, France

3d ago

Technical Program Manager - Agentic AI USD 155K-230K

AI | AI Governance | AI Inference | AI ethics | AI inference pipelines

Career development | Learning and growth | Mentorship | Travel for client work

Mid-level Full Time

USA - Remote, United States R

3d ago

AI Engineer USD 137K-210K

AI pipeline | AI pipeline architecture | LLM Evaluation | Langchain | Langgraph

Flexible time off | Health and wellbeing support | Learning and development budget | Parental leave | Team events

Mid-level Full Time

Austin, Texas; San Francisco Bay Area, …

4d ago

AI Platform & Business AI Solutions Lead – Mobility Aftermarket CNY 240K-480K

AI Platform | Automation | DevOps | Drift Detection | GraphRAG

Career growth opportunities | International work environment

Senior-level Full Time

Shanghai, China

4d ago

Project Lion - Senior Prompt Engineer - France (Remote, Part-Time) EUR 75K-105K

Automated Prompt Generation | Automated prompt optimization | Chain-of-Thought | Data Analysis | Few-Shot Learning

Part-time | Remote work

Senior-level Freelance Part Time

France R

5d ago

Lead Site Reliability Engineer, Data Infrastructure EUR 53K-74K

Chef | Cloud platform | Evaluation tools | GPU Workloads | Go

25 days holiday | Dog-friendly office | Gym in Vilnius | Home office support | Hybrid work model

Senior-level Full Time

Vilnius, Lithuania

8d ago

Full-Stack JavaScript Engineer

AI architecture | AI system observability | Cloud infrastructure | E2E Testing | LLM Evaluation

Collaborative team | Flexible remote work | Paid days off | Work with AI and technology

Senior-level Full Time

Ukraine, Remote R

8d ago

Machine Learning Engineer USD 185K-303K

Airflow | BigQuery | Convolutional Neural Networks | Data Processing | Distributed Systems

401k with employer match | Family planning support | Flexible vacation | Gender-affirming care | Healthcare benefits

Mid-level Full Time

Remote - United States R

11d ago

Manual QA Engineer (Middle) ID51808 EUR 36K-54K

AI Testing | AI frameworks | API Testing | Azure OpenAI | Defect Analysis

Flexible schedule | Mentorship | Personalized growth plans | Remote options | Team activity budgets

Mid-level Full Time

Coimbra, Portugal

14d ago

Lead Architect – AI Enablement & Automation (.NET) INR 2500K-4500K

.Net 8 | AI Observability | AI Search | AI orchestration | AWS

Flexible work arrangements | Inclusive environment

Senior-level Full Time

Bengaluru, Karnataka, India

15d ago

Senior Data Scientist USD 137K-184K

.NET | Azure | C# | Causal Inference | Generative AI

401k match | Dental insurance | FSA | Fertility support | Financial planning

Senior-level Full Time

US MA Remote, United States R

16d ago

Senior Data Scientist - ML Operations & Analytics

Data Analysis | Data Visualization | LLM Evaluation | Machine Learning | Prompt Optimization

Senior-level Contract Full Time

Prague

18d ago

Manual QA Engineer (Middle) ID51808 CAD 75K-85K

AI Testing | API Testing | Automation awareness | Defect Reporting | Jenkins

Competitive pay | Flextime | Growth roadmaps | Mentorship | Modern projects

Mid-level Full Time

SOLOLA, Guatemala

18d ago

Manual QA Engineer (Middle) ID51808 PLN 153K-248K

AI/ML | AI/ML concepts | Agile methods | Azure OpenAI | Browser Developer Tools

Competitive pay | Flexible schedule | Fortune 500 projects | Growth roadmaps | Mentorship

Mid-level Full Time

Warsaw, Poland

21d ago

Manual QA Engineer (Middle) ID51808 CAD 75K-85K

AI Testing | API Testing | Agile methodologies | Azure OpenAI | Browser Developer Tools

Flexible schedule | Mentorship | Personalized growth | Remote option | Team activities

Mid-level Full Time

ROSARIO, Argentina

22d ago

AI/ML Engineer INR 2000K-3000K

Airflow | Alteryx | Basket analysis | Clustering | Dimension reduction

Mid-level Full Time

GBS Chennai, India

24d ago

IN_Senior Associate_Azure AI _GCC_Advisory_Bangalore INR 2500K-3500K

AI Search | AI/ML | AI/ML engineering | API Development | Agentic AI

Community of solvers | Flexible programs | Inclusive benefits | Mentorship

Senior-level Full Time

Bengaluru Millenia, India

24d ago

AI Engineer AED 240K-240K

AI Foundry | AWS SageMaker | Agent Frameworks | Agentic AI | Azure AI

Career growth | Health insurance | Inclusive environment | Professional development support | Training opportunities

Senior-level Contract Full Time

Abu Dhabi, Abu Dhabi, United Arab …

1mo ago

Find jobs in AI/ML, Data Science and Big Data