44 jobs for LLM-as-a-Judge

Arize | Asyncio | Authentication and Authorization | Autogen | BLEU

Senior-level Full Time

New York, New York, United States

1d ago

Agentic loops | Benchmarking | Distributed Systems | Distributed task orchestration | Evaluation Pipelines

Birthday leave | Confidential Employee Assistance Programme | Flexwork arrangements | Medical insurance | Parental leave

Entry-level Full Time Internship

Petaling Jaya, Malaysia

4d ago

Principal Software Engineer, Applied AI Services MXN 721K-840K

AWS | Airflow | Amazon Web Services | Apache Airflow | Apache Kafka

Senior-level Full Time

Mexico City

5d ago

Senior AI Engineer USD 124K-174K

Agent Orchestration | Artificial Intelligence | CI/CD | Human-in-the-loop | LLM-as-a-Judge

Senior-level Full Time

Virtual - Illinois, United States R

6d ago

Lead AI Engineer / Architect (m/w/d) - Agentic Systems EUR 47K-47K

API Integration | Agent systems | Benchmarking | Computer Vision | Data Drift

Bare Metal GPU Cluster Access | Company bike leasing | Company events | Employer Subsidy | Flexible work hours

Senior-level Full Time

Heidelberg

6d ago

Senior AI Engineer | Sage Home Loans USD 150K-220K

Agent Orchestration | Automated Regression | Automated regression testing | Cost Optimization | DPO

401k match | Disability insurance | Employee assistance program | Flexible paid time off | Flexible spending accounts

Senior-level Full Time

Charlotte, NC R

6d ago

Data Scientist (Gen/Agentic AI solutions) INR 2500K-4500K

Anthropic API | CI/CD | Caching | Databricks | Docker

Senior-level Full Time

Navi Mumbai, MH, IN, 400708

11d ago

Senior AI/ML Scientist GBP 72K-100K

AI Foundry | AWS | Azure | Azure AI | Azure AI Foundry

26 days holiday | Flexible benefits | Healthcare cash plan | Incentive scheme | Income protection

Senior-level Full Time

London - Senator House, United Kingdom

11d ago

Data Scientist II USD 100K-130K

Anthropic API | Cloud Computing | Containers | Deep learning | DeepEval

English lessons | Extra paid month for birthing caregivers | Gym coverage | Hybrid & flexible working | Internet coverage

Mid-level Full Time

Buenos Aires

11d ago

Lead Agentic AI Engineer PLN 268K-408K

APIs | AWS | AWS QuickSight | Agent systems | Agentic AI

Conference budget | Health insurance | MacBook Pro | Permanent contract | Remote work

Senior-level Full Time

Remote Poland, Poland R

12d ago

Lead Agentic AI Engineer EUR 56K-84K

API Development | AWS QuickSight | Agent systems | Claude | Data Ingestion

Conference budget | Health insurance | MacBook Pro provided | Permanent contract | Remote work

Senior-level Full Time

Remote Portugal, Portugal R

12d ago

Senior AI Engineer USD 161K-243K

CI/CD | Experiment tracking | GCP | Generative AI | JSONB

401k match | Dental insurance | Disability insurance | Employee assistance program | Health insurance

Senior-level Full Time

Remote R

13d ago

Staff AI/ML Engineer (LLMs) USD 108K-227K

AWS Bedrock | Arize Phoenix | BERT | Bitbucket | CUDA

Flexible time off | Learning resources

Senior-level Full Time

606 KING OF PRUSSIA PA, United …

15d ago

Senior Software Engineer II - Applied AI (Remote Eligible) USD 192K-245K

AI Gateways | AWS CDK | Chunking | Context engineering | Cost Tracking

401k match | Counseling membership | Flexible time away | Life insurance | Long-term disability

Mid-level Full Time

-REMOTE, USA- R

15d ago

Applied Scientist USD 129K-217K

Classification | Databricks | Experiment design | Feature Engineering | Feature Selection

Mid-level Full Time

Remote-USA, United States R

18d ago

[2026] Data Scientist, Foundation AI - PhD Early Career USD 185K-221K

A/B | A/B Testing | B testing | Causal Inference | Data Generation

Equity compensation | Health benefits | Onsite work schedule

Mid-level Full Time

San Mateo, CA, United States R

20d ago

Ingénieur Machine Learning Ops H/F EUR 45K-50K

Azure | BigQuery | CI/CD | Docker | GCP

CSE access | Health insurance | Meal tickets | Relocation for sustainable mobility | Telework

Mid-level Full Time

Paris, IDF, France R

21d ago

Data Science I-HO & SUPPORT-CVM CoE - Corporate Centre of Excellence INR 2500K-4500K

AI Governance | AIOps | Adversarial Machine Learning | Airflow | CI/CD

Senior-level Full Time

Bangalore, Karnataka, India

25d ago

Data Science I-HO & SUPPORT-CVM CoE - Corporate Centre of Excellence INR 2500K-4500K

AI Agents | AI Governance | AIOps | Adversarial Machine Learning | Airflow

Senior-level Full Time

Bangalore, Karnataka, India

25d ago

Data Science I-HO & SUPPORT-CVM CoE - Corporate Centre of Excellence INR 2500K-4500K

AIOps | Adversarial Machine Learning | Airflow | CI/CD | Content Safety

Senior-level Full Time

Bangalore, Karnataka, India

25d ago

Principal Engineer, LLM (Platform and Tooling) USD 238K-330K

Cloud Architecture | Cost Optimization | Data Privacy | Docker | Explainability

401k match | Catered lunches | Company holidays | Employee assistance program | Employee resource groups

Senior-level Full Time

United States | Remote R

26d ago

Senior Machine Learning Engineer USD 205K-270K

A/B | A/B Testing | Agent systems | B testing | Benchmarking

Commuter benefits | Flexible PTO | In-office meal program | Medical, dental, and vision insurance | Paid parental leave

Senior-level Full Time

United States (Remote) R

27d ago

Senior AI Engineer INR 2500K-3500K

AWQ | Autogen | CI/CD | Caching | CrewAI

Career coaching and development | Flexible working hours | Health and insurance benefits | Professional onboarding and training

Senior-level Full Time

IND - Bengaluru - Esko-Graphics India … R

28d ago

Senior AI Engineer INR 2500K-4000K

AWQ | Agentic AI | Autogen | CI/CD | Caching

Annual leaves | Career coaching | Flexible working hours | Health benefits | Insurance benefits

Senior-level Full Time

IND - Bengaluru - Esko-Graphics India …

28d ago

Senior AI Engineer INR 2500K-4000K

AWQ | Agentic AI | Autogen | CI/CD | Caching

Senior-level Full Time

IND - Bengaluru - Esko-Graphics India …

29d ago

Lead Agentic AI Engineer EUR 56K-79K

ANN | Agent Orchestration | Agile | Approximate Nearest Neighbor | CI/CD

Senior-level Full Time

Portugal - Remote R

29d ago

Senior Automation and AI Developer JPY 8000K-13000K

AI Foundry | AI Search | AI Services | Azure AI | Azure AI Foundry

Senior-level Full Time

Kochi, KL, IN, 682303

29d ago

AI Developer with Python for Customer Care AI Platform team (hybrid) EUR 53K-53K

Agent systems | Asyncio | Context Augmented Generation | Elasticsearch | Embeddings

Flat hierarchies | Hybrid work | Modern tech environment | Team-based culture

Senior-level Full Time

Berlin, Germany R

1mo ago

Applied Scientist , Amazon Customer Service USD 142K-222K

Agentic AI | Artificial Intelligence | Dataset curation | Direct Preference Optimization | Embedding Models

Mid-level Full Time

Santa Clara, California, USA

1mo ago

Senior Staff Research Engineer, DeepMind USD 262K-365K

Algorithms | Artificial Intelligence | Benchmarking | Data Analysis | Data Structures

Senior-level Full Time

Mountain View, CA, USA

1mo ago

Python AI Engineer AUD 140K-175K

Automated testing | CI/CD | Docker | FastAPI | Kubernetes

Collaborative work environment | Professional growth and development

Senior-level Full Time

Sydney, New South Wales 2000, Australia

1mo ago

Senior AI Software Engineer USD 215K-250K

AWS Bedrock | AWS CloudFront | AWS Cognito | AWS ECR | AWS S3

401k plan | Dental insurance | Disability insurance | Flexible PTO | Health insurance

Senior-level Full Time

Remote R

1mo ago

Senior ML/AI Engineer EUR 60K-84K

API Integration | AWS | Agent systems | Automated Evaluation | Cloud platform

Flexible work culture | Global opportunities | High-impact environment | Professional development | Vibrant community

Senior-level Full Time

Barcelona - Spain

1mo ago

Principal AI/ML Architect USD 165K-185K

AWS Lambda | Airflow | Amazon Bedrock | Amazon Kinesis | Amazon OpenSearch

401k with company match | Company issued laptop | Dental insurance | Equipment and office stipend | Flexible spending account

Senior-level Full Time

USA R

1mo ago

GEN AI Sr Data Scientist/Data Scientist USD 90K-166K

Agent Development Kit | Agent workflows | Benchmarking | Context modeling | Cost Optimization

Hybrid work arrangement | Remote work option

Senior-level Full Time

Hartford CT- Home Office, United States

1mo ago

Senior Research Scientist - NLP USD 128K-266K

Adapter methods | Data Pipelines | Decoder Only | Deep learning | Distributed Training

401k | Backup childcare | Education stipends | Healthcare | Hybrid work options

Senior-level Full Time

US - United States of America

1mo ago

Senior Applied Scientist USD 180K-230K

Direct Preference Optimization | Distributed Training | Human Feedback | LLM-as-a-Judge | Language Models

Senior-level Full Time

Palo Alto

1mo ago

Summer Internship - AI Researcher USD 58K-70K

API Design | Agent systems | Anthropic Claude | Human-in-the-loop | JavaScript

Inclusive culture | Remote-first work culture

Entry-level Internship

Remote, United States R

1mo ago

Senior Quality Engineer II (AI & Data) INR 1975K-2625K

API Testing | Automation Testing | Generative AI | Human-in-the-loop | Jailbreak

Mid-level Full Time

Makkah, Makkah Province, Saudi Arabia

1mo ago

Staff Data Engineer USD 108K-227K

AWS | AWS Lambda | Agile | Amazon Bedrock | Amazon EC2

Flexible time off | Learning resources

Senior-level Full Time

606 KING OF PRUSSIA PA, United …

1mo ago

AI Data Scientist - Vice President USD 125K-185K

Data Processing | Dynamic routing | Embeddings | Graph Clustering | K-Means

Educational resources | Family building benefits | Generous vacation | Health and wellbeing benefits | Hybrid work model

Executive-level Full Time

Cary, 3000 CentreGreen Way, United States

1mo ago

AI Solutions Engineer - Data as a Service USD 172K-300K

API | DPO | Data Curation | Data Pipelines | Evaluation

Equity

Mid-level Full Time

New York City, NY (Hybrid); Redwood … R

1mo ago

Lead Agentic AI Engineer EUR 60K-85K

API Development | AWS | AWS QuickSight | Agent architectures | Agentic AI

Conference budget | Health insurance | MacBook Pro provided | Office work option | Permanent contract

Senior-level Full Time

Barcelona, Spain R

1mo ago

Sr. Staff Enterprise AI Architect USD 132K-244K

ABAC | Agent observability | Autonomous Agents | CI/CD | Data masking

Flexible work arrangements

Senior-level Full Time

United States

1mo ago

Find jobs in AI/ML, Data Science and Big Data