155 jobs for Evaluation Frameworks

Practice Customer Engineer, Applied AI, Google Public Sector USD 153K-222K

Agent tooling | Artificial Intelligence | C++ | Cloud Architecture | Conversational AI

Secret clearance | Travel

Senior-level Full Time

Atlanta, GA, USA; Austin, TX, USA

16h ago

Analytics Funding Specialist AUD 118K-127K

Analytics Programming | Data Modeling | Data analytics | Evaluation Frameworks | Healthcare Analytics

Mid-level Full Time

DOCKLANDS, VIC, AU, 3008

1d ago

Senior Consultant - AI Training & Evaluation (MBB & Top-Tier Firms) USD 120K

Analytical writing | Business Analysis | Data Synthesis | Evaluation Frameworks | Financial Modeling

Individual contributor | Project based work | Remote work

Senior-level Full Time

United States - Remote R

1d ago

Sr Principal Applied AI Engineer USD 178K-320K

APIs | Agentic Workflows | Benchmarking | Cloud services | Computer Vision

Senior-level Full Time

AMER - United States - Kansas … R

1d ago

Staff Machine Learning Engineer, Voice AI USD 220K-280K

Audio codecs | Audio signal processing | Batching | CUDA | Deep learning

Health insurance | Startup equity

Senior-level Full Time

San Francisco

1d ago

AI Research Engineer (Multi-Modal & Vision) - 100% Remote Worldwide USD 198K-307K

Benchmarking | Data Balancing | Data Filtering | Dataset curation | Distributed Training

Remote work worldwide

Senior-level Full Time

Remote job R

1d ago

Senior AI/ML Developer USD 165K-225K

AWS Bedrock | Anthropic API | CI/CD | Cloud deployment | Containers

Career Development Programs | Collaborative culture | Flexible time off | Flexible work schedules | Health and wellness benefits

Senior-level Full Time

Remote- UK R

1d ago

Multimodal AI Engineer, Document Understanding USD 180K-250K

Benchmarking | Computer Vision | Data Pipelines | Distillation | Distributed Systems

Access to compute resources and research tools | Catered lunch and snacks | Conference budget | Hybrid work options | Medical, dental, and vision coverage

Senior-level Full Time

San Francisco

1d ago

AI Engineer CAD 129K-142K

AI vector search | Agent Development Kit | Agentic Systems | CI/CD | Cloud platform

Flexible benefits

Mid-level Full Time

Toronto - 181 Bay St, Canada

2d ago

Senior AI/ML Technology Specialist EUR 61K-85K

AI Foundry | AI Search | API Management | Agentic Orchestration | Azure AI

Industry expert mentorship | Participation in large-scale projects | Professional development

Senior-level Full Time

Athens, Attica, Greece

2d ago

Research Engineer, Responsibility Engineering, DeepMind GBP 250K-340K

Automated testing | Evaluation Frameworks | Inference pipeline | JAX | Language Processing

Senior-level Full Time

London, UK

2d ago

Applied AI Engineer A USD 165K-300K

AWS | Adapters | ArangoDB | Asynchronous programming | Distributed Systems

401k | Dental insurance | Health insurance | Learning stipend | Relocation assistance

Senior-level Full Time

Florida, Florida, United States

2d ago

AI Engineer USD 157K-283K

API Integration | Agentic Workflows | Autogen | Cloud infrastructure | CrewAI

Senior-level Full Time

USA MD Columbia (Field), United States

3d ago

Prompt Engineering Architect USD 119K-228K

Agent systems | Agentic Systems | Embeddings | Evaluation Frameworks | LLM APIs

Career growth | Remote work

Senior-level Full Time

United States - Remote R

3d ago

AI Solutions Architect (34385) USD 138K-220K

21 CFR Part 11 | AI Foundry | Authentication | Authorization | Autonomous Agents

Senior-level Full Time

Jacksonville, FL, USA

3d ago

AI Tooling Engineer A AUD 127K-157K

Agent architecture | Benchmarking | ES Modules | Edge Functions | Embeddings

Annual learning budget | Annual offsite gatherings | Co working membership allowance | Equity participation | Flexible, asynchronous work culture

Senior-level Full Time

Australia R

3d ago

AI Tooling Engineer A ZAR 500K-730K

API | Agent architecture | Benchmarking | Bundlers | CLI

Annual off-site gatherings | Co working membership allowance | Equity participation ESOP | Flexible work culture | Fully remote

Senior-level Full Time

South Africa R

3d ago

AI Tooling Engineer A MXN 698K-800K

Agent architectures | Benchmarking | Bundlers | Database Design | Developer tools

Annual learning and development budget | Annual off-site gatherings | Co working membership allowance | Equity participation | Flexible, asynchronous work culture

Senior-level Full Time

Mexico R

3d ago

AI Tooling Engineer A INR 1800K-2800K

Agent architecture | Benchmarking | Database Design | ES Modules | Embeddings

Co working membership allowance | Equity participation | Flexible, asynchronous work culture | Fully remote | Health coverage

Senior-level Full Time

India R

3d ago

Prompt Engineering Architect USD 119K-225K

Agentic Workflows | Chunking | Embeddings | Evaluation Frameworks | Fine Tuning

Senior-level Full Time

United States - Remote R

4d ago

Prompt Engineering Architect USD 119K-228K

Agentic Workflows | Chunking | Embeddings | Evaluation Frameworks | Fine Tuning

Senior-level Full Time

United States - Remote R

4d ago

AI Engineer USD 130K-165K

Agent Frameworks | Agent Orchestration | Artificial Intelligence | Code review | Deployment

401k match | Company holidays | Dental insurance | Medical insurance | Paid time off

Entry-level Full Time

Houston, Texas, United States

5d ago

Head of Engineering USD 220K-300K

APIs | APM | AWS | Azure | Backend Frameworks

Executive-level Full Time

Boston

5d ago

Senior Forward Deployed AI Engineer (Remote Eligible in the UK) GBP 75K-92K

AI Act | AI Governance | AWS Bedrock | Agent Orchestration | Agent deployment

Remote eligible in UK | Travel opportunities

Senior-level Full Time

London, UK R

5d ago

Senior AI Architect USD 134K-237K

AI orchestration | Agentic AI | Auditability | Caching | Chunking

401k matching program | Adoption Assistance | Development and career growth | Fertility treatments | Flexible work schedules

Senior-level Full Time

Virtual Office (Colorado), United States R

6d ago

Senior Scientific Data Engineer USD 128K-156K

Agent systems | Agentic Workflows | Benchmarking | Biomedical Ontologies | Calibration

Flexible work environment | Healthcare benefits | Remote work | Retirement plan

Senior-level Full Time

Remote - United States, United States R

6d ago

Team Leader - Document Research GBP 70K-71K

Agreement Modeling | Calibration | Code review | Data Annotation | Data Governance

Senior-level Full Time

London

6d ago

Strategy Consultant - AI Training & Evaluation (MBB & Top-Tier Firms) AUD 91K-124K

Analytical Thinking | Evaluation Frameworks | Financial Modeling | Hypothesis-driven | Hypothesis-driven thinking

Individual Contributor Role | Project-based role | Remote work

Mid-level Full Time

Australia - Remote R

7d ago

Forward Deployed Engineer USD 150K-220K

Agent Development | Code debugging | Distributed Systems | Evaluation Frameworks | Inference infrastructure

Mid-level Full Time

Boston, MA, US

8d ago

VP Senior AI/AML Engineer USD 125K-188K

AML | API Integration | AWS | Agent Development | Agent Development Kit

Senior-level Full Time

6400 LAS COLINAS BLVD IRVING, United …

8d ago

AI Solutions Scientist EUR 62K-79K

AI Safety | Data Processing | Evaluation Frameworks | Generative AI | LLM Evaluation

Senior-level Full Time

(HE)Office Madrid J. Camarillo, Spain

8d ago

Lead AI Software Engineer USD 136K-188K

AWS | Agent Orchestration | Automated testing | Cloud Native | Containers

Hybrid work up to three days from home

Senior-level Full Time

New York City, NY (hybrid) R

8d ago

Senior AI Engineer USD 98K-136K

AI Safety | API Development | AWS | AWS Bedrock | Agentic Systems

401k matching | Medical/Dental/Vision insurance | Paid time off

Senior-level Full Time

Canada

8d ago

Staff AI Scienitist INR 2500K-5000K

AI Agents | AWS Bedrock | AWS SageMaker | Agent systems | Agentic AI

Senior-level Full Time

IND19-01-Bengaluru-EPIP 122 (Phase II), India

9d ago

Senior Research Scientist, Post-Training LLM and DLM USD 168K-304K

Data Structures | Data structures algorithms | Diffusion Models | Distributed Computing | Evaluation Frameworks

Benefits | Equity

Senior-level Full Time

US, CA, Santa Clara, United States

9d ago

Data Scientist – Agentic AI / Graph/ LLM Science , Assistant Vice President USD 90K-157K

AWS | Azure | Cloud platform | Embeddings | Evaluation Frameworks

401k match | Dental insurance | Employee assistance program | Flexible work/life support | Health insurance

Executive-level Full Time

Quincy, Massachusetts, United States

9d ago

Applied AI Engineer CAD 115K

API | Agent Orchestration | Async | CI/CD | CrewAI

Mid-level Full Time

Montreal, QC, CA

9d ago

AI Architect CZK 1098K-1248K

Active Learning | Artificial Intelligence | Evaluation Frameworks | Human Feedback | Language Processing

Senior-level Full Time

Prague, Czech, Czechia

9d ago

Senior Data Scientist – Agentic AI / Graph/ LLM Science, Vice President USD 120K-202K

AWS | Agentic AI | Azure | Cloud Computing | Cloud platform

Senior-level Full Time

Quincy, Massachusetts, United States

9d ago

Machine Learning Engineer Lead USD 115K-192K

Agentic Systems | Artificial Intelligence | Autonomous Agents | CI/CD | Deterministic Workflows

Annual incentive bonus

Senior-level Full Time

USA - Raleigh, NC (RDU), United …

9d ago

Strategy & Execution Manager, GTM USD 130K-223K

Agent Orchestration | Apache Spark | Artificial Intelligence | Cloud Data | Cloud data warehousing

Mid-level Full Time

United States

9d ago

Senior Software Engineer, AI Infrastructure - Developer Tooling USD 202K-368K

Automated testing | BM25 | Benchmarking | Chunking | Code Execution

Senior-level Full Time

Seattle, Washington, United States

9d ago

Data Scientist III INR 2535K-4225K

Agentic AI | Apache Spark | CrewAI | Data Modeling | Data Processing

Senior-level Full Time

Hyderabad, India

10d ago

Senior AI Engineer USD 187K-215K

Agent systems | Agno | AugmentCode | Benchmarks | CI/CD

Collaborative work environment | Comprehensive dental insurance | Comprehensive medical insurance | Comprehensive vision insurance | Equity participation

Senior-level Full Time

California R

10d ago

Senior AI Engineer - Argentina EUR 49K-79K

AI Observability | Agentic Systems | Automated testing | BigQuery | CI/CD

Birthday leave | Paid learning days | Private medical insurance | Team recognition rewards | Work from home allowance

Senior-level Full Time

Buenos Aires, Buenos Aires, Argentina

11d ago

Director, Forward Deployed Engineering GBP 174K-250K

API Design | AWS | Access Management | Agentic AI | Azure

Executive-level Full Time