AI QA Trainer - LLM Evaluation - Freelance Project

World Wide - Remote R

USD 12K-130K Senior-level Freelance

@ I...

Apply Save

Found 30d ago

Tasks

Design and run test plans and regression suites
Evaluate language models on factual accuracy and logical soundness
Identify and document failure modes and error traces
Partner on adversarial red-teaming and automation
Suggest improvements for prompt engineering and evaluation metrics

Perks/Benefits

Skills/Tech-stack

Education

Bachelor of Science | Master of Science | PhD

Roles

AI | AI QA | AI QA Engineer | Engineer | QA Engineer

Apply Save

Language: en | Views: 2 | Clicks: 2 | Saves: 0

Related jobs

Senior GenAI Solution Engineer (all genders) EUR 65K-84K

AWS Bedrock | Anthropic API | Async | Azure OpenAI | CI/CD

Company bike | Company events | Fitness membership subsidy | Flexible working hours | Home office

Mid-level Full Time

Hamburg, München, Düsseldorf, remote R

1h ago
AI Engineering Leader USD 137K-195K

Artificial Intelligence | Compliance | Compliance Management | Data Engineering | Databricks

Cell phone allowance | Equity grants | Growth-focused environment | Health coverage | Home office setup allowance

Senior-level Full Time

Remote- US R

8h ago
Sr. Embedded Detection Analyst USD 170K-205K

AI tools | Alert Correlation | Cause analysis | Data Analysis | Detection engineering

Senior-level Full Time

Remote - USA R

9h ago
Machine Learning Engineer - Perception USD 161K-237K

3D data | 3D data processing | Cloud processing | Computer Vision | Data Generation

401k retirement plan | Dental insurance | Employee referral bonus | Flexible PTO | Free lunch

Senior-level Full Time

Columbus, Ohio or Remote R

14h ago
Senior AI Software Engineer USD 215K-250K

AWS Bedrock | AWS CloudFront | AWS Cognito | AWS ECR | AWS S3

401k plan | Dental insurance | Disability insurance | Flexible PTO | Health insurance

Senior-level Full Time

Remote R

14h ago
Staff Software Engineer, Databases USD 180K-220K

C++ | Computer Architecture | Distributed Storage | Distributed Systems | Graph Database

Equity | Health benefits

Senior-level Full Time

Remote R

14h ago
Analytics Engineer

Amazon QuickSight | Business Continuity | Business Intelligence | Data Backup | Data Governance

Additional paid time off | Early stage company equity potential | Health insurance | Indefinite term contract | Learning budget

Senior-level Full Time

Trabajo a distancia R

14h ago
AI Engineering Intern USD 70K-96K

AI Safety | Artificial Intelligence | Evaluation Methodologies | Experiment design | Machine Learning

Entry-level Internship

1 Remote R

14h ago
Staff Data Engineer BRL 325K-443K

AWS Glue | AWS Glue Catalog | Amazon MWAA | Amazon S3 | Apache Airflow

Remote work

Senior-level Full Time

São Paulo, SP, Brazil R

15h ago
Senior AI Engineer CAD 120K-150K

Agent Orchestration | Agent systems | Artificial Intelligence | Autonomous Agents | Dynamic routing

Birthday off | Generous vacation package | Health days | Health spending account | Hybrid work

Senior-level Full Time

Toronto R

15h ago
Power BI Engineer USD 70K-136K

Azure AD | Column-Level Security | DAX | Data Gateways | Data Governance

Mid-level Full Time

Washington, DC R

17h ago
Data Engineer PHP 420K-480K

AWS | Amazon Redshift | Apache Airflow | Apache Spark | BigQuery

Employee discount | Health insurance | Mentorship | Sports voucher | Training opportunities

Mid-level Full Time

Alabang, Philippines (Hybrid) R

18h ago
Data Engineers EUR 30K-36K

Amazon S3 | Apache Airflow | Apache Spark | CI/CD | Data Quality

Company training | Conference attendance | Flexible compensation benefits | Flexible working hours | Indefinite contract

Mid-level Full Time

Madrid, MD, Spain R

19h ago
Sr. Data and AI Engineer USD 180K-200K

Agile | Amazon Web Services | Azure | Big Data | Data Architecture

Public trust clearance support | Remote work

Senior-level Full Time

Work from home, VA, United States R

19h ago
Remote Lead Software Engineer A USD 160K-257K

AWS | Agile | Amazon Web Services | Apache Spark | Data Engineering

Access to cutting-edge technologies | Collaborative team environment | Flexible work hours | Professional development opportunities | Remote work within United States

Senior-level Full Time

Massachusetts R

19h ago
Senior Software Engineer - Remote A USD 125K-158K

AWS | Agile | Apache Kafka | Apache Spark | Databricks

Access to cutting-edge technologies | Flexible work hours | Inclusive culture | Professional development | Remote work within the U.S

Senior-level Full Time

Minnesota R

19h ago
Sr. Software Engineer - REMOTE A USD 135K-160K

AWS | Agile | Apache Spark | Databricks | DevOps

Access to cutting-edge technologies | Autonomy | Flexible work hours | Inclusive culture | Professional development

Senior-level Full Time

Idaho R

19h ago
Senior Software Engineer (Remote) A USD 135K-160K

AWS | Agile | Big Data | Data Pipelines | Databricks

Access to cutting-edge technologies | Autonomy in role | Flexible work hours | Inclusive company culture | Professional development

Senior-level Full Time

Columbia R

19h ago
Lead Software Development Engineer (remote) A USD 135K-160K

AWS Cloud | Agile | Amazon Web Services | Apache Spark | Databricks

Access to cutting-edge technologies | Autonomy in role | Flexible work hours | Inclusive company culture | Professional development

Senior-level Full Time

Florida R

19h ago
Remote Software Development Engineer - Senior A USD 140K-180K

AWS | Agile | Apache Spark | Databricks | DevOps

Access to cutting-edge technologies | Autonomy | Equity opportunities | Flexible work hours | Inclusive culture

Senior-level Full Time

California R

19h ago
Sr. Software Development Engineer (Remote) A USD 135K-160K

AWS | Agile | Apache Spark | Databricks | GitLab

Access to cutting-edge technologies | Autonomy | Collaborative team environment | Flexible work hours | Inclusive company culture

Senior-level Full Time

Connecticut R

19h ago
Senior Software Development Engineer - REMOTE A USD 125K-158K

AWS | Agile | Apache Spark | Batch Processing | Big Data

Access to cutting-edge technologies | Autonomy | Flexible work hours | Inclusive company culture | Professional development

Senior-level Full Time

Arizona R

19h ago
Senior Data Engineer (Perm, Ireland, Hybrid ) EUR 46K-79K

Amazon Redshift | Amazon Web Services | Apache Spark | Automation | CI/CD

Flexible working hours | Income protection | Paid time off | Pension match | Private healthcare

Senior-level Full Time

Permanent R

19h ago
Senior Data Engineer (Perm, Italy, Hybrid) EUR 51K-79K

Agile | Amazon Redshift | Amazon Web Services | Apache Spark | Automation

Death in service cover | Health insurance | Paid time off | Pension match | Remote working allowance

Senior-level Full Time

Permanent R

19h ago
Senior Data Engineer (Perm, UK, Hybrid) EUR 44K-79K

AWS | Amazon Redshift | Apache Hadoop | Apache Spark | Automation

Death in service coverage | Income protection | Marriage leave | Paid time off | Pension match

Senior-level Full Time

Permanent R

19h ago