LLM Model Response Evaluation
Maryland City, MD, United States
R
USD 150K-200K (estimate) Mid-level Contract Full Time
Tasks
- Apply detailed project guidelines in evaluation platform
- Assess factuality consistency aesthetics and other criteria
- Conduct independent research using trusted sources
- Evaluate UI widgets infographics images audio video HTML widgets and PDFs
- Evaluate model generated content against quality rubrics
Perks/Benefits
Skills/Tech-stack
GenAI | Language Models | Large Language Models | Multimodal evaluation
Education
Roles
Regions
Countries
States
Cities
Related jobs
-
AI Fluency Education Lead USD 270K-365KAdult Learning | Content development | Curriculum Design | Instructional Design | Interactive learningSenior-level Full TimeSan Francisco, CA | New York … R2d ago
-
AI Engineer I USD 90K-119KAPI Integration | Azure | CI/CD | Chroma | Docker401k match | Dental insurance | Holidays | Medical insurance | Personal Time OffEntry-level Full TimeRemote, CA, USA R2d ago
-
Calibration | Data Generation | Deep learning | Distillation | EHREquity | Health benefits | High autonomySenior-level Full TimeNew York, NY, United States R3d ago
-
AI Operations & Data Analyst USD 69K-103KAWS | Artificial Intelligence | Bias Mitigation | Cloud Platforms | Data Automation401k savings plan | Casual dress attire program | Educational assistance | Employee discounts | Employee referral bonusMid-level Full TimeMelville, NY, United States R3d ago
-
AI / ML Engineer USD 95K-130KAWS | AWS Lambda | AWS Step Functions | Agent Orchestration | Amazon Bedrock401k | Dental insurance | Employee assistance program | Employee stock purchase plan | FSASenior-level Full TimeLincoln - Nelnet Center, United States R3d ago
-
AI Strategy & Execution Senior Manager USD 139K-200KAI Governance | AI ROI | AI Risk | AI risk management | AnalyticsCareer Development Programs | Flexible work schedules | Health and wellness benefits | Leadership development programs | Mental health counselingSenior-level Part TimeUS MT Remote, United States R3d ago
-
APIs | AWS | Anthropic | Azure | Big DataHybrid work model | Paid Holidays | Paid time off | Time off for personal and family care | Travel 20 to 30 percentEntry-level Full TimeMcLean, VA, US, 22102 R3d ago
-
AI Engineer, Mid USD 77K-176KAPI | Agile | Apache Spark | Automation | CI/CDDependent care | Paid leave | Professional development | Tuition assistance | Work-life programsEntry-level Full TimeUSA, TX, San Antonio (3133 General … R3d ago
-
Oracle AI Data Pipeline Engineer USD 99K-225KAI Agents | AWS | Cloud Architecture | Cloud infrastructure | DashboardsDependent care | Disability insurance | Financial benefits | Health insurance | Life insuranceMid-level Full TimeUndisclosed Location - USA, VA, Reston, … R3d ago
-
AI Interaction Designer USD 140K-155KAgent Frameworks | Agent systems | Compliance | Deterministic systems | EmbeddingsCareer growth | MentorshipMid-level Full TimeUnited States - Remote R3d ago
-
AI Data Scientist USD 114K-218KAWS | Cloud platform | DBSCAN | Decision Trees | Generative AI401k | Adoption Assistance | Career path planning | Continuing education | Hybrid/Remote flexibilityMid-level Full TimeSan Antonio Home Office I, United … R3d ago
-
Senior AI Engineer (NYC) USD 144K-236KA/B | A/B Testing | B testing | Deep learning | Fine TuningHealth and wellness programs | Hybrid work flexibility | Mentorship | Paid time offSenior-level Full TimeNew York, NY, United States R3d ago
-
Applied AI Engineer USD 122K-176KAI Agents | AWS | Automated testing | Azure | CI/CD401k match | Educational assistance program | Employee assistance program | Employee discounts | Employee referral programMid-level Full TimeRemote (United States) R3d ago
-
Director, AI Engagements USD 270K-325KAPI Integration | Agentic Workflows | Artificial Intelligence | Claude API | Data FlowExecutive-level Full TimeRemote, United States; UK - Remote R3d ago
-
Director of AI Engineering USD 180K-240KAPI Development | Agent systems | Deployment | JavaScript | Langchain401k | Annual bonus | Dental insurance | Equity incentive plan | Flexible vacationExecutive-level Full TimeU.S. Remote R3d ago
-
AI Prompt Engineer / AI Application Engineer USD 84K-110KAgentic Workflows | Anthropic Claude | Authentication | Azure DevOps | CI/CDEntry-level Full TimeNew York, NY, United States R3d ago
-
Senior AI Engineer, VideoAI USD 144K-236KA/B | A/B Testing | Apache Spark | B testing | Data MiningHealth and wellness programs | Hybrid work schedule | Time away from workSenior-level Full TimeMountain View, CA, United States R4d ago
-
Forward Deployed AI Lead USD 210K-232KAI Governance | Agentic AI | Anthropic Claude | Artificial Intelligence | CI/CD401(k) plan match | Company-provided laptop | Dental insurance | Disability insurance | Equipment stipendSenior-level Full TimeUSA R4d ago
-
Senior-level Full TimeBellevue R4d ago
-
Lead AI Engineer USD 160K-213KAgentic Workflows | Artificial Intelligence | CI/CD | Data Engineering | LLM ApplicationsHybrid work model | In-office collaboration | Remote flexibilitySenior-level Full TimeTel Aviv-Yafo, Tel Aviv District, IL R4d ago
-
AI Research Engineer USD 100K-150KAccelerators | Computer Vision | Deep learning | Distributed Training | JAXSenior-level Full TimeUnited States - Remote R4d ago
-
Generative AI Specialist USD 100K-150KAgent Frameworks | Agent systems | Chunking | Embeddings | Evaluation FrameworksCareer growth potentialSenior-level Full TimeUnited States - Remote R4d ago
-
AI/ML Engineer & Data Management Specialist (Journeyman) USD 118K-130KAccess Control | Artificial Intelligence | Audit trails | Compliance | Data MigrationOn-site workMid-level Full TimePatuxent River, MD R4d ago
-
Prompt Engineer USD 100K-150KAgent Frameworks | Cost Optimization | Embeddings | Evaluation | IndexingSenior-level Full TimeUnited States - Remote R4d ago
-
AI Software Engineer II USD 100K-157KAWS | Azure | C# | CI/CD | Data Pipelines401k match | Continuous training | Dental insurance | Health insurance | Professional developmentMid-level Full TimeUnited States - Remote R4d ago