LLM Model Response Evaluation
Maryland City, MD, United States
R
USD 150K-200K (estimate) Mid-level Contract Full Time
Tasks
- Apply detailed project guidelines in evaluation platform
- Assess factuality consistency aesthetics and other criteria
- Conduct independent research using trusted sources
- Evaluate UI widgets infographics images audio video HTML widgets and PDFs
- Evaluate model generated content against quality rubrics
Perks/Benefits
Skills/Tech-stack
GenAI | Language Models | Large Language Models | Multimodal evaluation
Education
Roles
Regions
Countries
States
Cities
Related jobs
-
AI Agents | API Development | Azure | CI/CD | LLMOpsCollaborative cross-functional team | Fully remoteMid-level Full TimeCanada, Ontario; Toronto, None; Toronto, Ontario; … R1d ago
-
AI/ML Engineer USD 152K-220K3D Reconstruction | 3D Scene | 3D Scene Understanding | AI Agents | Cloud ComputingAgile team collaboration | Fully remote | Production monitoring ownershipMid-level Full TimeSan Francisco, CA (Hybrid) or United … R1d ago
-
Senior GTM AI Engineer USD 154K-213KAgent Orchestration | Agent Performance | Agent Performance Monitoring | Anthropic Claude | App Development401k match | Catered lunch | Company events | Desk setup stipend | Flexible spending accountsSenior-level Full TimeOakland, California, United States R1d ago
-
800-37 | 800-53 | AI Governance | AI orchestration | AI red teaming401k | Dental insurance | Disability insurance | Employee assistance program | Hybrid work scheduleSenior-level Full TimeWashington, DC R2d ago
-
AWS | Agent systems | Apache Spark | Azure | Cloud platformOn site customer collaboration | Remote work | Travel for customer visitsSenior-level Full TimeWashington, D.C. R2d ago
-
Staff AI Engineer, GenAI USD 200K-230KAgentic AI | Apache Spark | Azure DevOps | Azure ML | CI/CDPaid caregiver leave | Paid sick leave | Paid vacationSenior-level Full TimeUSA - NY - Remote, United … R2d ago
-
Senior AI/ML Engineer USD 145K-235KAI Services | API Integration | AWS | Agent Orchestration | Agent systems401k company match | Advancement opportunities | Collaborative work environment | Community support | Dental insuranceSenior-level Full TimePhoenix AZ, United States R2d ago
-
API Integration | Agentic AI | Artificial Intelligence | CI/CD | DevSecOpsMid-level Full TimeUnited States - Remote R2d ago
-
AI Researcher II (Intern) - United States USD 44K-185KAI System Design | AWS | Agentic AI | Data Curation | Data Pipelines401k matching | Dental insurance | Floating holiday | Health insurance | Life insuranceEntry-level Internship Part TimeSan Francisco, California, United States of … R2d ago
-
Lead AI Insights Engineer USD 129K-162KAWS SageMaker | Amazon Bedrock | Amazon Web Services | Claims data | DBTRemote workSenior-level Full TimeRemote - OH, United States R2d ago
-
AI Interaction Designer USD 140K-155KAgent Frameworks | Agent architectures | Deterministic Evaluation | Embeddings | Evaluation PipelinesSenior-level Full TimeUnited States - Remote R2d ago
-
AWS | Agentic AI | Code review | Foundation Models | GCP401k plan | Hybrid work schedule | Paid time off | Tuition reimbursement | Visa sponsorshipSenior-level Full Time141753-NC-Three Wells Fargo Center, Charlotte, United … R2d ago
-
Head of AI & Program Technology Engineering USD 185K-200KAgentic Systems | Artificial Intelligence | Azure | Backup and Recovery | CI/CDSenior-level Full TimeNew York, NY HQ USA, United … R2d ago
-
Principal AI Engineer USD 180K-200KAPI Development | AgentCore) | Agentic AI | AutoGPT | CI/CD401k employer match | Career advancement | Employee assistance program | Employee recognition | FSASenior-level Full TimeRemote US R3d ago
-
Senior AI Engineer USD 180K-240KCause analysis | Context Management | Evaluation Frameworks | Experiment design | Golden datasetsCompetitive compensation | Equity compensation | Remote-first environmentSenior-level Full TimeRemote, Americas R3d ago
-
AI Developer USD 120K-155KAPI Development | API Integration | Agent Orchestration | Agile | Amazon BedrockOnsite hybrid work environment | W2 employmentMid-level Full TimeSFI - Crystal City R3d ago
-
AI/ML Engineer USD 220K-260KAUC | AWS | CI/CD | Cross-validation | Databricks401k matching | Commuter benefits | Dental insurance | Health insurance | Paid lunch and dinnerSenior-level Full TimeNew York R3d ago
-
AI Engineer USD 120K-145KAPI | API Integration | Azure Cloud | Azure Cloud Services | Azure Data401k match | Dental insurance | Disability insurance | Employee assistance program | FSA optionsMid-level Full TimeNaperville, IL; Denver, CO R3d ago
-
Product Engineer, AI Email App USD 150K-215KA/B | A/B Testing | B testing | Cost Optimization | ExperimentationMid-level Full TimeUnited States R3d ago
-
AI Researcher, AI.x USD 150K-247KAgentic Workflows | Data Analysis | Deep learning | Experimentation | GenAIHybrid work | On-site collaborationSenior-level Full TimeSan Francisco, CA, United States R3d ago
-
API Integration | AWS | Cloud Computing | Data pipeline | Deep learning40 hours per week work schedule | Immediate start opportunity | Internship program | Remote work opportunityEntry-level Full Time InternshipRemote, United States R3d ago
-
AI/ML Engineer USD 195K-264KAI RMF | AWS Bedrock | AWS SageMaker | Agentic AI | Azure Machine Learning401k matching | Career growth support | Paid time off | Remote work | Wellness packagesSenior-level Full TimeUSA LA Home Office (LAHOME), United … R3d ago
-
AI Prompt Engineer USD 61K-122KAgile | Chain-of-Thought | Embeddings | Few-Shot Learning | Few-shotContinuing education | Financial benefits | Flexible time off | Healthcare benefits | Learning and developmentEntry-level Full Time405 ASHBURN VA (ASHBURN CACI/CLIENT REIMB … R3d ago
-
Mid-level Full TimeOhio WFH, United States R3d ago
-
AI Software Engineer, Senior USD 86K-198KAWS | Access Control | Agentic Workflows | Asynchronous programming | Automated testingDependent care | Paid leave | Professional development | Secret clearance | Tuition assistanceSenior-level Full TimeUSA, HI, Joint Base Pearl Harbor … R3d ago