221 jobs for Evaluation Frameworks

Digital & GenAI Analyst - Consulting INR 2500K-5000K

Agent systems | Agentic Systems | Benchmarking | Deep learning | Direct Preference Optimization

Senior-level Full Time

India

1d ago

Generative AI / Azure AI Engineering Lead AED 192K-234K

ACL | AI Foundry | AI Search | API Security | Agent systems

Senior-level Full Time

Dubai, Arenco Tower, United Arab Emirates

1d ago

Applied AI Engineer EUR 54K-75K

Agent workflows | Cost Optimization | Data Pipelines | Evaluation Frameworks | Inference

Senior-level Full Time

Ireland

1d ago

Software Engineer, Applied AI USD 200K-300K

AWS | Agent tooling | Amazon S3 | Evaluation Frameworks | FastAPI

401k retirement plan | Commuter benefits | Gym membership | Medical/Dental/Vision insurance | Paid time off

Senior-level Full Time

New York City

1d ago

Technical Specialist, ML Data USD 159K-202K

Active Learning | Data Curation | Data Mining | Data Pipelines | Data Quality

Discretionary annual bonus | Equity incentive plan | Health benefits

Senior-level Full Time

Mountain View, CA, United States

3d ago

AI Engineer (Europe) HUF 12540K-18000K

AWS | Agentic Workflows | Apache Spark | Azure | CI/CD

Flexible work-life balance | International projects | Learning & development opportunities | Mentoring system

Mid-level Contract Full Time

Budapest, Hungary

3d ago

Senior Software Engineer AI/ML - Payments EUR 61K-86K

Agent Orchestration | Agentic Systems | Benchmarking | Context engineering | Ensemble Methods

Senior-level Full Time

Amsterdam

3d ago

Expert / Director of Al USD 170K-250K

Agent systems | Architecture | Artificial Intelligence | Benchmarking | Deep learning

Senior-level Full Time

APAC

3d ago

Director of Software Engineering - Python, Gen AI INR 4000K-6000K

A/B | A/B Testing | AWS | Anthropic | B testing

Executive-level Full Time

Bengaluru, Karnataka, India

4d ago

Applied Machine Learning Researcher A AUD 130K-180K

DPO | Data Curation | Data labeling | Evaluation Frameworks | Experimentation

Fully remote | High ownership role | In-person gatherings | Opportunities for growth | Remote flexibility

Senior-level Full Time

Australia R

4d ago

LLM Prompt Specialist USD 100K-150K

Agentic Workflows | Embeddings | Evaluation Frameworks | Fine Tuning | Guardrails

Mid-level Full Time

United States - Remote R

4d ago

Prompt Engineer USD 100K-150K

Agentic Workflows | Chunking | Embeddings | Evaluation Frameworks | Fine Tuning

Career growth | Remote work

Senior-level Full Time

United States - Remote R

4d ago

Blackstone Credit & Insurance - AI Engineer, Principal USD 215K-250K

API Development | AWS | Agent Frameworks | Artificial Intelligence | Azure

Senior-level Full Time

New York, United States

4d ago

Blackstone Credit & Insurance - AI Engineer, Principal USD 215K-250K

AI Agents | API Development | APIs | AWS | Cloud infrastructure

Senior-level Full Time

San Francisco, United States

4d ago

Blackstone Credit & Insurance - AI Engineer, Principal USD 215K-250K

APIs | AWS | Agent Frameworks | Artificial Intelligence | Cloud deployment

401k plan | Discretionary bonuses | FSA benefits | Health benefits | Life insurance

Senior-level Full Time

New York, United States

4d ago

Blackstone Credit & Insurance - AI Engineer, Principal USD 215K-250K

API Development | AWS | Agent Frameworks | Artificial Intelligence | Azure

Senior-level Full Time

San Francisco, United States

4d ago

AI Engineering Lead EUR 38K-63K

API Development | Azure AI | CI/CD | Cloud Computing | Distributed Systems

Senior-level Full Time

Bratislava, SK

4d ago

Applied AI Engineer - Canada CAD 60K-70K

Agent Orchestration | Anthropic API | Benchmarking | CI/CD | End to End

Autonomy | Equity | Hybrid work

Entry-level Full Time

Calgary

4d ago

AI Software Engineer USD 170K-253K

Agent Development | Auth | CI/CD | Canary Releases | Evaluation Frameworks

Employee stock purchase plan | Health insurance | Leave options | Life insurance | Paid time off

Senior-level Full Time

Home - United States Tier 2 …

4d ago

Head of AI and Data Platform USD 172K-344K

A/B | A/B Testing | AWS | Artificial Intelligence | Automated retraining

Education benefit | Free medical coverage | Retirement savings plan | Student debt program | Tuition reimbursement

Executive-level Full Time

United States - Alameda : 2901 …

5d ago

Forward Deployment Engineer, Applied AI Agents (Intern) USD 54K-72K

Agent Loops | Agents SDK | Data Analysis | Evaluation Frameworks | Function Calling

Remote work

Entry-level Internship

United States, HOFFMAN ESTATES, REMOTE, REMOTE R

5d ago

AI Interaction Designer USD 100K-150K

Agentic Workflows | Chunking | Embeddings | Evaluation Frameworks | Indexing

Career growth

Senior-level Full Time

United States - Remote R

5d ago

Head of AI and Data Platform USD 172K-344K

A/B | A/B Testing | AWS | Artificial Intelligence | Automated retraining

Career development | Education benefit FreeU | Free medical coverage | Retirement savings plan | Student debt program

Executive-level Full Time

United States - Alameda : 2901 …

5d ago

Risk Modeling Solutions - GenAI - Vice President INR 4000K-6000K

AI Foundry | AI Governance | AI Search | AWS Bedrock | Autogen

Executive-level Full Time

Bangalore, Karnataka, INDIA; Mumbai, Maharashtra, INDIA

5d ago

Staff Software Engineer, Agentic Applications USD 198K-272K

Approval Workflow | Audit Logging | Behavioral Regression | Behavioral Regression Testing | Content Management

Senior-level Full Time

Mountain View, California

5d ago

Senior/Staff Machine Learning Engineer USD 223K-268K

API Integration | Anomaly Detection | Class Imbalanced Modeling | Databases | Drift Detection

Health benefits | Long-term incentives | Medical benefits | Performance bonus

Senior-level Full Time

San Jose, California, United States

5d ago

Senior AI Reliability Engineer (Platform) EUR 54K-75K

AWS | Adversarial Testing | Agent systems | Agentic Workflows | Airflow

Cross-functional collaboration | On-call rotation

Senior-level Full Time

Berlin Office

5d ago

Foundation AI Engineer (LLM) CAD 100K-110K

AI Feedback | Attention Mechanisms | Constitutional AI | Constitutional Safety Tuning | Data Curation

Annual health checkups | Healthcare insurance | Opportunity to collaborate with industry professionals | Performance bonuses | Preferential pricing for services

Mid-level Full Time

Hanoi, Vietnam

5d ago

Sr Enterprise AI Developer USD 135K-190K

API Integration | Access Management | Application development | Automated testing | Azure

401k match | Dental insurance | Employee discount | Food options | Hybrid work

Senior-level Full Time

Plano, TX, United States

5d ago

Applied AI/ML Engineer INR 1800K-3000K

Agent workflows | Agentic Systems | Auditability | Drift Detection | Error Handling

Mid-level Full Time

Bengaluru, Karnataka, India

5d ago

Chief Ai Engineer AUD 100K-173K

AI guardrails | Agentic Systems | Artificial Intelligence | Evaluation Frameworks | Generative AI

Culture leave | Employee mortgage discounts | Flexible work arrangements | Learning and development opportunities | Lifestyle leave

Executive-level Full Time

NSW, Australia

6d ago

Senior Machine Learning Engineer, Data Insights INR 2520K-4200K

AWS | Apache Airflow | Apache Spark | Azure | C++

Financial wellness support | Flexible work schedule | Healthcare benefits | Mental health support | Time off

Senior-level Full Time

Bengaluru, India

6d ago

IN_Associate_ GenAI and Agentic AI_GCC_ Advisory_ Bangalore INR 2500K-5000K

API Development | Agent Orchestration | Agent alignment | Asynchronous programming | Autogen

Flexibility programmes | Inclusive benefits | Mentorship | Wellbeing support

Senior-level Full Time

Bengaluru Millenia, India

6d ago

Staff AI Engineer USD 161K-249K

AWS | Adversarial Testing | Agentic Systems | Alignment | Bias Assessment

Disability coverage | Discounted tuition | Flexible paid time off | Flexible spending account | Health savings account

Senior-level Full Time

Raleigh Office, United States

6d ago

ML Agent Engineer USD 155K-300K

CI/CD | Distributed machine learning | Distributed testing | Evaluation Frameworks | ML monitoring

Mid-level Full Time

San Francisco Bay Area; Seattle Metro …

6d ago

AI Software Engineer (Agentic Workflows, Production Systems) BRL 300K-360K

Asynchronous programming | CI/CD | Elasticsearch | Embeddings | Evaluation Frameworks

Hybrid work option | Medical healthcare | Ongoing learning reimbursement | Recognition program | Referral bonuses

Senior-level Full Time

Brazil

6d ago

Senior Director, Applied AI Product USD 200K-250K

AI Product Management | AI RMF | Backlog prioritization | CCPA | Continuous Improvement

401k plan | Equity program | Flexible location | Generous PTO | Health, dental, vision coverage

Senior-level Full Time

Philadelphia, PA R

6d ago

Lead Data Scientist USD 130K-200K

A/B | A/B Testing | Agents | B testing | Evaluation Frameworks

401k | Dental insurance | Medical insurance | Vision insurance

Senior-level Full Time

New York City, NY (Hybrid); San … R

6d ago

Lead Machine Learning Engineer - Generative AI and Agent Platforms USD 177K-215K

Agent Orchestration | Agent systems | Amazon Web Services | Artificial Intelligence | Automated testing

Senior-level Full Time

Jersey City, NJ, United States

6d ago

Senior Software Engineer, AI Infrastructure - LVM Inference & Evaluation USD 168K-205K

Batching | Benchmarking | Caching | Cloud infrastructure | Computer Vision

401k plan | Dental insurance | Flexible time off | Health insurance | Life insurance

Senior-level Full Time

Redwood City

6d ago

Staff AI Engineer USD 177K-209K

AI Safety | AI architecture | API Design | AWS | AWS GenAI

Senior-level Full Time

US Remote R

6d ago

Senior Product Manager, AI Data Intelligence USD 192K-279K

Agent observability | Agent workflows | Artificial Intelligence | Autonomous Agents | Business Intelligence

Senior-level Full Time

San Jose, CA, USA

6d ago

AI Software Engineer, Senior USD 86K-198K

AWS | Access Control | Asynchronous programming | Automated testing | CI/CD

Dependent care | Disability insurance | Health insurance | Life insurance | Paid leave

Senior-level Full Time

USA, HI, Joint Base Pearl Harbor …

7d ago

Machine Learning Quality Engineer GBP 78K-109K

Evaluation Frameworks | Integration Testing | LLM | Python | RAG

Healthcare | Paid volunteering days | Retirement planning | Wellbeing initiatives

Senior-level Full Time

GBR-London-10 Paternoster Square, United Kingdom

7d ago

Principal AI Engineer CAD 138K-221K

AI Observability | API Design | AWS | Access Management | Agent Orchestration

Senior-level Full Time

Toronto, Canada

7d ago

Senior Forward Deployed ML Engineer, Agents GBP 145K-200K

AWS | Azure | CI/CD | Cloud platform | Computer Vision

Equity | Flexible work options | Wellness benefits

Senior-level Full Time

London, England, United Kingdom

7d ago

VP Mgr-Applied AI Engineering USD 168K-244K

AI architecture | Artificial Intelligence | CI/CD | DevOps | Evaluation Frameworks

Executive-level Full Time

London, United Kingdom

7d ago

Staff AI Engineer - API & Integrations Team (Barcelona) EUR 55K-60K

API Design | Agentic Workflows | Evaluation Frameworks | Human-in-the-loop | LLM

Breakfast in office | Food discounts | Gym access | Language classes | Organic fruit

Senior-level Full Time

Barcelona, CT, Spain

7d ago

Senior Manager, Data Quality & Evaluation A AUD 113K-161K

Adjudication | Annotation Guidelines | Calibration | Cause analysis | Dashboards

Flexible work location | Fully remote | International team collaboration | Leadership influence on quality strategy | Professional growth opportunities

Senior-level Full Time

Australia R

7d ago

Senior Manager, Data Quality & Evaluation A RON 258K-288K

Adjudication | Annotation quality | Audio evaluation | Calibration | Cause analysis

Continuous improvement culture | Flexible work location | Fully remote | Innovation-focused workplace | International team collaboration

Senior-level Full Time

Romania R

7d ago

Find jobs in AI/ML, Data Science and Big Data