AI QA Trainer - LLM Evaluation - Freelance Project

World Wide - Remote R

USD 12K-130K Senior-level Freelance

@ I...

Apply Save

Found 10d ago

Tasks

Design and run test plans and regression suites
Evaluate language models on factual accuracy and logical soundness
Identify and document failure modes and error traces
Partner on adversarial red-teaming and automation
Suggest improvements for prompt engineering and evaluation metrics

Perks/Benefits

Skills/Tech-stack

Education

Bachelor of Science | Master of Science | PhD

Roles

AI | AI QA | AI QA Engineer | Engineer | QA Engineer

Apply Save

Language: en | Views: 0 | Clicks: 0 | Saves: 0

Related jobs

Senior Software Engineer INR 3200K-4225K

Access Control | Airflow | Artificial Intelligence | Astronomer | CI/CD

Senior-level Full Time

Pune, India R

3h ago
Databricks Pipeline Architect USD 150K-180K

AWS Glue | AWS Lambda | AWS S3 | Agile | Amazon Web Services

Public trust clearance support | Remote work

Senior-level Full Time

Work from home, VA, United States R

10h ago
Tier 3 Network Systems Engineer (Remote) USD 80K-101K

Active Directory | Ansible | Ansible Playbook | Apache HTTP | Apache HTTP Server

After hours availability | Customer support support | On-call rotation | Remote work

Mid-level Full Time

Dallas, TX, US R

10h ago
Legal AI Engineer GBP 70K-96K

AI Evaluation | Artificial Intelligence | Benchmarking | Contract Law | Document analysis

Free access to Genie platform | Fully remote working | Home office setup | Learning and development budget | Parental leave

Mid-level Full Time

London, United Kingdom R

17h ago
Staff Machine Learning Engineer - Integrations & Solutions Group (AU remote) AUD 80K-132K

APIs | AWS | Benchmarking | Cloudflare Workers | Evaluation

Equity packages | Flexible leave options | Inclusive parental leave | Virtual interviews | Wellbeing allowance

Senior-level Full Time

Melbourne, VIC, Australia R

21h ago
Staff Machine Learning Engineer - Integrations & Solutions Group (AU remote) AUD 80K-132K

API Design | AWS | Cloudflare Workers | Evaluation | Language Models

Equity packages | Flexible leave options | Inclusive parental leave | Office setup allowance | Social connection allowance

Senior-level Full Time

Sydney, Australia R

21h ago
Senior Machine Learning Engineer - Integrations (AU remote) AUD 119K-132K

API Design | AWS | Agent architecture | Benchmarking | Cloudflare Workers

Equity packages | Flexible leave | Flexible work arrangements | Parental leave | Wellbeing allowance

Senior-level Full Time

Melbourne, VIC, Australia R

21h ago
Senior Machine Learning Engineer - Integrations (AU remote) AUD 119K-132K

API Design | AWS | Agent architecture | Benchmarking | Cloudflare Workers

Equity packages | Flexible leave options | Inclusive parental leave | Wellbeing allowance

Senior-level Full Time

Sydney, Australia R

21h ago
Senior Machine Learning Engineer USD 150K-200K

Distributed Systems | Feature Engineering | Feature Selection | Language Models | Language Processing

401k matching | Cell phone and internet stipend | Employee stock purchase plan | Flexible time off | Learning programs

Senior-level Full Time

Remote - USA R

22h ago
Senior Software Engineer - Data Platform USD 186K-218K

Access Control | Airflow | Apache Kafka | Apache Spark | Caching

Senior-level Full Time

Remote - USA R

1d ago
Cloud DevOps Engineer USD 180K-210K

Bash | BigQuery | CI/CD | Cloud Run | Datadog

Senior-level Full Time

Hybrid (Salt Lake City, UT, US) R

1d ago
Software Engineer, Data USD 120K-250K

Alerting | Anomaly Detection | Avro | BigQuery | ClickHouse

Dental insurance | Flexible vacation policy | Health insurance | Open Source contribution | Vision insurance

Mid-level Full Time

Remote, U.S R

1d ago
Sr. HR Systems Engineer INR 2100K-2600K

APIs | AWS | Access Management | Auditability | Compliance

Senior-level Full Time

Bangalore, INDIA R

1d ago
AI Solutions Architect INR 2500K-4500K

AWS | Convolutional Neural Networks | Data Governance | Distributed Systems | Docker

Senior-level Full Time

India - Remote R

1d ago
Senior Azure Fabric Data Engineer INR 1500K-2000K

Airflow | Azure | Azure Data | Azure Data Factory | Azure Data Lake

Remote work | Work from home

Senior-level Full Time

India - Remote R

1d ago
Senior Solutions Engineer (Canada) CAD 120K-140K

API Integration | Apache Spark | Cloud Operations | Data Pipelines | Data Validation

Dental insurance | Flexible hours | Flexible-hybrid work | Health insurance | Parental leave

Senior-level Full Time

Remote - Calgary, Alberta, Canada R

1d ago
Senior Solutions Engineer (UK) GBP 59K-80K

API Integration | Apache Spark | Cloud Computing | Data Pipelines | Data Quality

Dental insurance | Flexible hours | Flexible-hybrid work | Health insurance | Paid vacation

Senior-level Full Time

Remote - London, Greater London, United … R

1d ago
Computer Vision Engineer TWD 1000K-1500K

3D Geometry | C++ | Camera Calibration | Computer Vision | Git

International travel | Travel 50 percent to factory

Senior-level Full Time

Remote - Taiwan R

1d ago
Analytics Engineer (Data Platform) GBP 70K-95K

AWS DMS | Amazon Web Services | Automation | CI/CD | DBT

Annual leave | Corporate events | Employee assistance program | Enhanced maternity/paternity pay | Extra holiday

Mid-level Full Time

London, England, United Kingdom R

1d ago
Robotics Perception Engineer USD 140K-204K

C++ | CI/CD | Camera-based perception | Cameras | Cloud processing

Company-provided laptop | Dental insurance | Health insurance | Paid time off | Remote work option

Mid-level Full Time

Atlanta, Georgia, United States - Remote R

1d ago
Robotics Hardware Integration Engineer USD 120K-158K

AWS IoT | AWS IoT Core | AWS IoT Greengrass | C++ | CAN

Direct impact on shipped products | Early-stage company | Equity | Health, dental, and vision insurance | Permissive time off policy

Mid-level Full Time

Atlanta, Georgia, United States - Remote R

1d ago
Robotics Navigation and Control Engineer USD 160K-240K

A Star | C++ | CI/CD | EKF | Gazebo

Company laptop | Health, dental, vision benefits | Permissive time off | Remote work | Travel to Atlanta facility for hardware integration

Senior-level Full Time

Atlanta, Georgia, United States - Remote R

1d ago
Senior Software Engineer INR 1800K-2400K

AWS | Apache Atlas | Google Cloud | JUnit | Java

Career development | Employee resource groups | Flexible WFH policy | Generous PTO | Internet reimbursement

Senior-level Full Time

India-Bangalore-Remote R

1d ago
Sr. Full Stack Engineer – AI/ML USD 151K-220K

API Design | Alerting | Architecture Documentation | Artificial Intelligence | Capacity Planning

Senior-level Full Time

Remote Office - KY, United States R

1d ago
Principal, AI Data Science GBP 85K-100K

AWS | Automated Data Collection | Data Monitoring | Data Privacy | Data collection

Dental insurance | Flexible Paid Vacation | Medical insurance | Retirement savings plan | Vision insurance

Senior-level Full Time

UK - Home-Based, United Kingdom R

1d ago