47 jobs for LLM-as-judge

Artificial Intelligence Senior Associate A USD 128K-204K

API Design | BigQuery | CI/CD | Chunking | Cloud Build

Hybrid work | Local preferred | Onsite 4 days per week

Mid-level Full Time

Dearborn, United States R

21h ago

Data Science Engineering Manager ILS 120K-180K

AI coding | AI coding assistant | AWS | Amazon SQS | Apache Spark

Mid-level Full Time

Ramat Gan, Israel, IL R

1d ago

Senior AI Engineer INR 3000K-5000K

A/B | A/B Testing | API Design | Access Control | Access Controls

Relocation assistance

Senior-level Full Time

Bengaluru, India

5d ago

AI Engineer USD 50K-112K

Adversarial Benchmarking | Data Pipelines | Deep learning | Fine Tuning | Generative AI

Entry-level Full Time

TPA ESC-4040 W Boy Scout Blvd, …

5d ago

Senior Data Scientist (AI Evaluation & Improvement) USD 135K-165K

A/B | A/B Testing | B testing | Cause analysis | Data Analysis

Autonomy to execute work | Flexibility in work schedule | Work-life balance

Senior-level Full Time

Work at Home, United States

5d ago

AI safety & Security controls, LLM Guardrails/Associate Director, Software Engineering Specialist INR 1400K-2400K

API Development | Asynchronous processing | Audit trails | Cloud Computing | Content Safety

Career development | Flexible working | Inclusive culture

Mid-level Full Time

Pune, Maharashtra, India R

6d ago

Data Scientist – AI Systems USD 115K-157K

AWS AgentCore | AWS Bedrock | AWS Fargate | AWS Lambda | Amazon SageMaker

401k match | Paid Holidays | Personal time | Sponsorship available | Vacation

Mid-level Full Time

Remote R

7d ago

Senior Agentic (AI) Engineer USD 160K-200K

A/B | A/B Testing | AWS | Agent SDK | ArgoCD

Dental insurance | Family leave | Flexible paid time off | Free food and snacks | Health insurance

Senior-level Full Time

Orlando, Florida, United States - Remote R

8d ago

Artificial Intelligence Senior Associate USD 401K

API Design | Best practices | BigQuery | CI/CD | Canary Deployment

401k match | Employee recognition culture | Employee referral program | Life insurance | Long-term disability

Mid-level Contract

Michigan

8d ago

Machine Learning Resident - Client: Fillip Fleet (12 month term) CAD 56K-70K

Adversarial Testing | Agentic AI | Benchmarking | CI/CD | Entity Resolution

Access to community and events | Mentorship | Opportunity for ongoing role | Paid residency | Professional development activities

Entry-level Full Time

Edmonton, Alberta, Canada

8d ago

Director- Applied AI USD 100K-181K

AI Evaluation | AI Risk | AI risk management | AWS | Agentic AI

401k match | Dental insurance | Disability insurance | Flexible time off | Health insurance

Executive-level Full Time

Lisle, IL, United States R

8d ago

Senior Data Scientist - (Content, Consumer) EUR 75K-85K

A/B | A/B Testing | B testing | CI/CD | Causal Inference

Corporate pension plan | Digital meal vouchers | Educational budget | Employee share purchase plan | Food vouchers

Senior-level Full Time

Berlin, Germany

8d ago

Customs AI Integration & Automation Engineer (Spain) EUR 55K-75K

APIs | AWS Bedrock | Azure AI | CI/CD | Cloud Computing

Certification budget | Conference budget | Hybrid working | Model and compute cost budget | Permanent role

Senior-level Full Time

Remote job R

13d ago

Agentic AI Engineer (AWS) AUD 100K-135K

AWS | AWS CDK | Agent systems | Alembic | Amazon Bedrock

Flexible working options | Market-leading parental leave | Mentoring coaching programs | Paid volunteering days | Professional development reimbursements

Mid-level Full Time

Sydney, NSW, AU R

14d ago

LLM Systems / AI Agent Engineer (Remote, Full-Time) [AS311] A INR 3000K-4500K

AI Agents | AWS Bedrock | Context engineering | Cost Optimization | Evaluation Pipelines

Community forums | Full medical insurance | Laptop provided | Mentorship | No weekend work

Mid-level Full Time

India R

15d ago

ML/AI Engineer, Applied AI A USD 180K-275K

APIs | Agent Orchestration | Chunking | Cloud infrastructure | Context Assembly

Direct collaboration with founders | High ownership | In-office Flexibility | In-office collaboration | Remote work

Senior-level Full Time

San Francisco, CA; New York, New …

16d ago

Research Fellowship (Applied AI/ML) BRL 600K

Adversarial Testing | Agentic tool use | Automatic Speech Recognition | Data Mining | Data Pipelines

Access to Real Enterprise Data | Chai Coffee | Coauthorship opportunities | Flexible work environment | Free Lunches

Entry-level Full Time

New Delhi, India

16d ago

Applied AI Engineer - iCloud Data USD 150K-220K

AI Foundry | Apache Flink | Apache Kafka | Azure AI | Azure AI Foundry

Senior-level Full Time

Cupertino; Seattle

20d ago

Product Manager, Applied AI (Staff / Senior Staff) USD 230K-300K

Agentic Systems | Artificial Intelligence | Data Flywheel | Data Modeling | Error Analysis

401k savings plan | Commuter benefits | Daily in-office meals | Healthcare FSA | Healthcare coverage

Senior-level Full Time

New York City, NY R

23d ago

Forward Deployed AI Engineer USD 176K-222K

AWS | Agent Orchestration | Agent SDK | Agent systems | Amazon Bedrock

Senior-level Full Time

Remote job R

26d ago

Forward Deployed AI Engineer USD 176K-222K

AWS | Agent Orchestration | Agent SDK | Amazon Bedrock | Anthropic Agent SDK

Career growth opportunities | Client embedded role | Future project consideration | Knowledge handover documentation

Senior-level Full Time

Remote job R

26d ago

AI / ML Engineer USD 95K-130K

AWS Bedrock | AWS Lambda | AWS Step Functions | Amazon ECS | Amazon S3

401k | Earned time-off | Employee stock purchase program | FSA | HSA

Senior-level Full Time

Lincoln - Nelnet Center, United States

28d ago

Senior AI Engineer GBP 50K-60K

Arize | Braintrust | CI/CD | Cost attribution | Golden datasets

Enhanced parental and adoption leave | Financial coaching | Flexible working | Hybrid or remote work | Paid learning and development

Senior-level Full Time

Leeds, Manchester, Edinburgh, London

28d ago

Staff Agentic AI Engineer CAD 130K-170K

AWS | Agent Orchestration | Data Contracts | Embeddings | Entity Resolution

Senior-level Full Time

Toronto , Canada

29d ago

AI Agent Algorithm Engineer Intern (Global E-Commerce, Affiliate) - 2027 Start (PhD) SGD 45K-57K

AI Feedback | Agent Orchestration | C++ | Context Compaction | Context Editing

Community events | Industry expert collaboration | Professional development events

Entry-level Internship

Singapore

30d ago

AI Agent Algorithm Engineer Intern (Global E-Commerce, Conversational AI) - 2027 Start SGD 57K-60K

C++ | Context engineering | Data Flywheel | Deep learning | Direct Preference Optimization

Career guidance | Development workshops | Hands-on experience | Industry exposure | Social events

Entry-level Internship

Singapore

30d ago

AI Agent Algorithm Engineer Intern (Global E-Commerce, Conversational AI) - 2027 Start (PhD) SGD 57K-60K

AI Feedback | C++ | Context Summarization | Deep learning | Direct Preference Optimization

Entry-level Internship

Singapore

30d ago

AI Agent Algorithm Engineer Graduate (Global E-Commerce, Conversational AI) - 2027 Start SGD 60K-65K

C++ | Context Compaction | Context Summarization | Deep learning | Direct Preference Optimization

Entry-level Full Time

Singapore

30d ago

AI Agent Algorithm Engineer Graduate (Global E-Commerce, Affiliate) - 2027 Start (PhD) SGD 42K-60K

C++ | Context Compaction | Context Summarization | Data Flywheel | Deep learning

Entry-level Full Time

Singapore

30d ago

Senior AI Engineer (Xora Portfolio Company) SGD 162K-220K

Async Programming | Automated scoring | Chunking | Context engineering | Embeddings

Senior-level Full Time

Singapore, Singapore, Singapore

1mo ago

AI & Machine Learning Teaching Expert (Part-time) USD 100K-200K

A/B | A/B Testing | Agentic Systems | Artificial Intelligence | B testing

Flexible schedule | Fully remote | Professional autonomy | Use of collaboration tools Notion Slack Zoom

Senior-level Part Time

Boston, US R

1mo ago

Application Software Engineer, Applied AI USD 125K-200K

.NET | A/B | A/B Testing | AI Observability | Agent Orchestration

401k plan | Company shuttles | Employee stock purchase plan | Life insurance | Long-term disability insurance

Senior-level Full Time

Redmond, WA

1mo ago

Application Software Engineer, Applied AI USD 160K-225K

.NET | A/B | A/B Testing | AI Observability | Agent Orchestration

Background check required | Extended hours weekends as needed | Onsite work required

Senior-level Full Time

Cape Canaveral, FL

1mo ago

Application Software Engineer, Applied AI USD 125K-160K

.NET | A/B | A/B Testing | Agent Orchestration | Agentic Systems

401k retirement plan | Life insurance | Long-term disability insurance | Medical/Dental/Vision insurance | Paid Holidays

Senior-level Full Time

Vandenberg, CA

1mo ago

Application Software Engineer, Applied AI USD 160K-225K

A/B | A/B Testing | Agent Orchestration | Agentic Systems | Angular

Onsite work

Senior-level Full Time

Starbase, TX

1mo ago

Application Software Engineer, Applied AI USD 160K-225K

A/B | A/B Testing | AI Observability | Agent Orchestration | Agentic Systems

Collaborative team environment | Extended hours weekends as needed | Onsite work

Senior-level Full Time

McGregor, TX

1mo ago

Application Software Engineer, Applied AI USD 160K-225K

.NET | A/B | A/B Testing | Agent Orchestration | Agentic Systems

Onsite work

Senior-level Full Time

Bastrop, TX

1mo ago

Application Software Engineer, Applied AI USD 125K-160K

.NET | A/B | A/B Testing | Agent Orchestration | Agentic Systems

401k plan | Disability insurance | Life insurance | Medical, dental, and vision coverage | Paid Holidays

Senior-level Full Time

Hawthorne, CA

1mo ago

Staff Applied Scientist, Reinforcement Learning USD 190K-270K

LLM Training | LLM-as-judge | Language Models | Language Processing | Large Language Models

Senior-level Full Time

Menlo Park, CA

1mo ago

Product Analyst INR 1670K-2129K

ASR Evaluation | Cohort Analysis | Cost analysis | Dashboards | Data Visualization

In-person collaboration | Learning and development | Professional development

Mid-level Full Time

Bengaluru, India (Onsite)

1mo ago

Senior AI/ Machine Learning Engineer INR 3242K-5000K

AWS | Agent memory | Azure | CI/CD | Context engineering

Senior-level Full Time

Pune, India

1mo ago

Senior WEM AQM Prompt Engineer USD 88K-247K

A/B | A/B Testing | API Integration | B testing | Calibration

Inclusive environment | Remote work | Team-first culture

Senior-level Full Time

United States (Remote) R

1mo ago

Senior AI Backend Engineer - Agent Evaluation & Quality USD 175K-250K

API Design | CI/CD | Cost Optimization | Experimentation | Function Calling

Senior-level Full Time

Makkah, Makkah Province, Saudi Arabia - … R

1mo ago

DS / ML Engineer INR 1800K-3000K

Data Pipelines | Drift Detection | Inference Optimization | Information Retrieval | LLM

Mid-level Full Time

Bangalore

1mo ago

Agentic AI Architect A USD 125K-200K

.NET | AI Foundry | AI Search | Application Insights | Azure AI

Senior-level Full Time

New York, New York, United States

1mo ago

Senior Data Scientist, Applied AI USD 138K-230K

Agent evaluation | Data Pipelines | Deep learning | Experimentation | FastAPI

Senior-level Full Time

San Francisco, CA

1mo ago

Sr. Software Engineer, GenAI USD 175K-220K

AWS | CI/CD | Docker | Drift monitoring | Embeddings

401k | Company laptop | Company retreats | Generous PTO | Health, dental, and vision insurance

Senior-level Full Time

Remote - USA R

1mo ago

Find jobs in AI/ML, Data Science and Big Data