227 jobs for Evaluation Frameworks

AI Software Engineer USD 170K-253K

Agent Development | Auth | CI/CD | Canary Releases | Evaluation Frameworks

Employee stock purchase plan | Health insurance | Leave options | Life insurance | Paid time off

Senior-level Full Time

Home - United States Tier 2 …

14h ago

Head of AI and Data Platform USD 172K-344K

A/B | A/B Testing | AWS | Artificial Intelligence | Automated retraining

Education benefit | Free medical coverage | Retirement savings plan | Student debt program | Tuition reimbursement

Executive-level Full Time

United States - Alameda : 2901 …

1d ago

Staff Software Engineer, Agentic Applications USD 198K-272K

Approval Workflow | Audit Logging | Behavioral Regression | Behavioral Regression Testing | Content Management

Senior-level Full Time

Mountain View, California

1d ago

Senior/Staff Machine Learning Engineer USD 223K-268K

API Integration | Anomaly Detection | Class Imbalanced Modeling | Databases | Drift Detection

Health benefits | Long-term incentives | Medical benefits | Performance bonus

Senior-level Full Time

San Jose, California, United States

1d ago

Senior AI Reliability Engineer (Platform) EUR 54K-75K

AWS | Adversarial Testing | Agent systems | Agentic Workflows | Airflow

Cross-functional collaboration | On-call rotation

Senior-level Full Time

Berlin Office

1d ago

Foundation AI Engineer (LLM) CAD 100K-110K

AI Feedback | Attention Mechanisms | Constitutional AI | Constitutional Safety Tuning | Data Curation

Annual health checkups | Healthcare insurance | Opportunity to collaborate with industry professionals | Performance bonuses | Preferential pricing for services

Mid-level Full Time

Hanoi, Vietnam

1d ago

Sr Enterprise AI Developer USD 135K-190K

API Integration | Access Management | Application development | Automated testing | Azure

401k match | Dental insurance | Employee discount | Food options | Hybrid work

Senior-level Full Time

Plano, TX, United States

1d ago

Applied AI/ML Engineer INR 1800K-3000K

Agent workflows | Agentic Systems | Auditability | Drift Detection | Error Handling

Mid-level Full Time

Bengaluru, Karnataka, India

1d ago

Chief Ai Engineer AUD 100K-173K

AI guardrails | Agentic Systems | Artificial Intelligence | Evaluation Frameworks | Generative AI

Culture leave | Employee mortgage discounts | Flexible work arrangements | Learning and development opportunities | Lifestyle leave

Executive-level Full Time

NSW, Australia

2d ago

Senior Machine Learning Engineer, Data Insights INR 2520K-4200K

AWS | Apache Airflow | Apache Spark | Azure | C++

Financial wellness support | Flexible work schedule | Healthcare benefits | Mental health support | Time off

Senior-level Full Time

Bengaluru, India

2d ago

IN_Associate_ GenAI and Agentic AI_GCC_ Advisory_ Bangalore INR 2500K-5000K

API Development | Agent Orchestration | Agent alignment | Asynchronous programming | Autogen

Flexibility programmes | Inclusive benefits | Mentorship | Wellbeing support

Senior-level Full Time

Bengaluru Millenia, India

2d ago

Staff AI Engineer USD 161K-249K

AWS | Adversarial Testing | Agentic Systems | Alignment | Bias Assessment

Disability coverage | Discounted tuition | Flexible paid time off | Flexible spending account | Health savings account

Senior-level Full Time

Raleigh Office, United States

2d ago

ML Agent Engineer USD 155K-300K

CI/CD | Distributed machine learning | Distributed testing | Evaluation Frameworks | ML monitoring

Mid-level Full Time

San Francisco Bay Area; Seattle Metro …

2d ago

AI Software Engineer (Agentic Workflows, Production Systems) BRL 300K-360K

Asynchronous programming | CI/CD | Elasticsearch | Embeddings | Evaluation Frameworks

Hybrid work option | Medical healthcare | Ongoing learning reimbursement | Recognition program | Referral bonuses

Senior-level Full Time

Brazil

2d ago

Senior Director, Applied AI Product USD 200K-250K

AI Product Management | AI RMF | Backlog prioritization | CCPA | Continuous Improvement

401k plan | Equity program | Flexible location | Generous PTO | Health, dental, vision coverage

Senior-level Full Time

Philadelphia, PA R

2d ago

Lead Data Scientist USD 130K-200K

A/B | A/B Testing | Agents | B testing | Evaluation Frameworks

401k | Dental insurance | Medical insurance | Vision insurance

Senior-level Full Time

New York City, NY (Hybrid); San … R

2d ago

Lead Machine Learning Engineer - Generative AI and Agent Platforms USD 177K-215K

Agent Orchestration | Agent systems | Amazon Web Services | Artificial Intelligence | Automated testing

Senior-level Full Time

Jersey City, NJ, United States

2d ago

Senior Software Engineer, AI Infrastructure - LVM Inference & Evaluation USD 168K-205K

Batching | Benchmarking | Caching | Cloud infrastructure | Computer Vision

401k plan | Dental insurance | Flexible time off | Health insurance | Life insurance

Senior-level Full Time

Redwood City

2d ago

Machine Learning Eng. (GenAI & Enterprise Systems) MXN 720K-1100K

AWS | Automated testing | Azure | CI/CD | Cost Optimization

Hybrid work environment

Senior-level Full Time

Ensenada R

2d ago

Data Scientist Proficient (Enterprise AI & GenAI)

Data Analysis | Embeddings | Evaluation Frameworks | Experimentation | Exploratory Data Analysis

Client-facing collaboration | Hybrid work

Mid-level Full Time

Mexico R

2d ago

Staff AI Engineer USD 177K-209K

AI Safety | AI architecture | API Design | AWS | AWS GenAI

Senior-level Full Time

US Remote R

2d ago

Senior Product Manager, AI Data Intelligence USD 192K-279K

Agent observability | Agent workflows | Artificial Intelligence | Autonomous Agents | Business Intelligence

Senior-level Full Time

San Jose, CA, USA

2d ago

AI Software Engineer, Senior USD 86K-198K

AWS | Access Control | Asynchronous programming | Automated testing | CI/CD

Dependent care | Disability insurance | Health insurance | Life insurance | Paid leave

Senior-level Full Time

USA, HI, Joint Base Pearl Harbor …

3d ago

Machine Learning Quality Engineer GBP 78K-109K

Evaluation Frameworks | Integration Testing | LLM | Python | RAG

Healthcare | Paid volunteering days | Retirement planning | Wellbeing initiatives

Senior-level Full Time

GBR-London-10 Paternoster Square, United Kingdom

3d ago

Principal AI Engineer CAD 138K-221K

AI Observability | API Design | AWS | Access Management | Agent Orchestration

Senior-level Full Time

Toronto, Canada

3d ago

Prompt Engineer USD 100K-150K

Agent systems | Agentic Workflows | Chunking | Embeddings | Evaluation Frameworks

Career growth | Full time W2 benefits | H1B transfer support | Remote work

Mid-level Full Time

United States - Remote R

3d ago

Senior Forward Deployed ML Engineer, Agents GBP 145K-200K

AWS | Azure | CI/CD | Cloud platform | Computer Vision

Equity | Flexible work options | Wellness benefits

Senior-level Full Time

London, England, United Kingdom

3d ago

VP Mgr-Applied AI Engineering USD 168K-244K

AI architecture | Artificial Intelligence | CI/CD | DevOps | Evaluation Frameworks

Executive-level Full Time

London, United Kingdom

3d ago

Staff AI Engineer - API & Integrations Team (Barcelona) EUR 55K-60K

API Design | Agentic Workflows | Evaluation Frameworks | Human-in-the-loop | LLM

Breakfast in office | Food discounts | Gym access | Language classes | Organic fruit

Senior-level Full Time

Barcelona, CT, Spain

3d ago

AI Agent Architect - Bengaluru INR 3000K-5000K

Agent architecture | Agent workflows | Benchmarking | Context engineering | Debugging

Senior-level Full Time

Bengaluru, Karnātaka, India

3d ago

Senior Manager, Data Quality & Evaluation A AUD 113K-161K

Adjudication | Annotation Guidelines | Calibration | Cause analysis | Dashboards

Flexible work location | Fully remote | International team collaboration | Leadership influence on quality strategy | Professional growth opportunities

Senior-level Full Time

Australia R

3d ago

Senior Manager, Data Quality & Evaluation A RON 258K-288K

Adjudication | Annotation quality | Audio evaluation | Calibration | Cause analysis

Continuous improvement culture | Flexible work location | Fully remote | Innovation-focused workplace | International team collaboration

Senior-level Full Time

Romania R

3d ago

Senior Manager, Data Quality & Evaluation A EUR 75K-120K

Adjudication | Annotation Guidelines | Annotation platforms | Audio evaluation | Calibration

Fully remote | International team collaboration | Professional growth opportunities

Senior-level Full Time

Netherlands R

3d ago

Senior Manager, Data Quality & Evaluation A EUR 75K-120K

AI Data | AI data workflows | Adjudication | Annotation | Audio evaluation

Fully remote | International team collaboration | Professional growth

Senior-level Full Time

Ireland R

3d ago

AI Solution Architect (w/m/d) EUR 53K-53K

AI Agents | APIs | Anthropic | Cloud technologies | Compliance

Additional vacation days | Betriebliche Altersvorsorge | Coffee | EGYM Wellpass | Fresh fruit

Senior-level Full Time

Remote in Germany R

3d ago

Director, AI Engineering USD 200K-200K

AI Foundry | AWS Bedrock | Agent SDK | Agentic Systems | Claude Agent SDK

Competitive benefits | Hybrid work

Executive-level Full Time

135 W 26th Street, New York, …

3d ago

Senior AI Solution Architect A EUR 75K-80K

API Design | AWS | Agent systems | Azure | CQRS

Diversity & inclusion | Employee well-being | Flexible remote work | Innovation projects | Professional growth

Senior-level Full Time

Spain

3d ago

Senior AI Solution Architect A EUR 75K-108K

API Design | AWS | Agent workflows | Azure | CQRS

Collaborative innovation environment | Continuous learning | Diversity & inclusion | Employee well-being | Flexible remote work

Senior-level Full Time

Ireland

3d ago

Senior AI Solution Architect A EUR 75K-80K

AI architecture | API Design | API enablement | AWS | Agentic AI

Collaborative & Inclusive Culture | Flexible remote work | Professional growth opportunities

Senior-level Full Time

Netherlands

3d ago

Senior AI Solution Architect A EUR 69K-91K

API Design | API enablement | AWS | Agent systems | Azure

Flexible remote work

Senior-level Full Time

Portugal

3d ago

Senior AI Solution Architect A CLP 24791K-30989K

API Design | API enablement | AWS | AWS CDK | Agent workflows

Diversity & inclusion | Flexible remote work | Innovation-focused projects | Professional growth opportunities | Supportive culture

Senior-level Full Time

Chile

3d ago

Senior AI Solution Architect A NOK 949K-1188K

API Design | AWS | AWS Cloud | AWS Cloud Development Kit | AWS cloud development

Diversity inclusion focused culture | Flexible remote work | Innovative AI transformation projects | Professional growth opportunities | Supportive learning environment

Senior-level Full Time

Norway

3d ago

Senior AI Solution Architect A EUR 75K-108K

API Design | API enablement | AWS | Agent systems | Azure

Collaborative innovation culture | Flexible remote work | Professional growth opportunities

Senior-level Full Time

Slovenia

3d ago

Prompt Engineering USD 100K-150K

Agentic Workflows | Chunking | Cost Optimization | Embeddings | Evaluation Frameworks

Benefits | Full-time W2 employment | Remote work

Mid-level Full Time

United States - Remote R

4d ago

Agentic AI Architect INR 3242K-5000K

.NET | AI Agents | AI Evaluation | AI Foundry | AI Memory Architectures

Senior-level Full Time

INMANBP Bangalore (INMANBP) Manyatha, India

4d ago

Senior Computer Scientist 1 INR 3264K-5000K

Agent Orchestration | Agent collaboration | Autogen | CI/CD | Cloud Native

Senior-level Full Time

Noida, India R

4d ago

AI Engineering Director PLN 282K-282K

AWS | Agentic Frameworks | Agentic Systems | Agno | Apache Airflow

Community service day | Culture celebration day | Employee assistance program | Life insurance | Onboarding program for new hires

Executive-level Full Time

Krakow, Poland R

4d ago

Prompt Engineer USD 100K-150K

Agent Frameworks | Agent systems | Deterministic Evaluation | Embeddings | Evaluation Frameworks

Mid-level Full Time

United States - Remote R

4d ago

AI Engineer, Exposure Management

AI Agents | AWS | Agentic Workflows | Autogen | Azure

Mid-level Full Time

Tel Aviv/ Hybrid (Israel), Israel R

4d ago

Staff AI Engineer USD 140K-210K

API Development | AWS | Access Management | Bedrock AgentCore | CI/CD

401k | All-hands meetings | Dental insurance | Employee equity program | Health insurance

Senior-level Full Time

New York City

4d ago

Find jobs in AI/ML, Data Science and Big Data