AI Interaction Evaluator (Codex / Claude Code, up to $200/hr)
Tasks
- Assess quality of explanations and reasoning
- Define response quality levels from poor to excellent
- Evaluate AI generated coding interactions end to end
- Judge output usefulness and high level correctness
- Provide clear opinionated feedback on what worked and what did not
Perks/Benefits
- N/A
Skills/Tech-stack
Claude Code | Cursor | JavaScript | OpenAI Codex | Python | TypeScript
Education
N/A
Regions
Countries
Canada | Ghana | United States
States
Alberta, CA | British Columbia, CA | Manitoba, CA | Ontario, CA | Quebec, CA | District of Columbia, US | Florida, US | Georgia, US | Oklahoma, US | Tennessee, US | Texas, US | Illinois, US | Indiana, US | Ohio, US | Colorado, US | Nevada, US | Idaho, US | Washington, US | Massachusetts, US | Pennsylvania, US | Virginia, US
Cities
Chicago, Illinois, US | Toronto, Ontario, CA | Montréal, Quebec, CA | Philadelphia, Pennsylvania, US | San Antonio, Texas, US | Dallas, Texas, US | Calgary, Alberta, CA | Edmonton, Alberta, CA | Jacksonville, Florida, US | Austin, Texas, US | Fort Worth, Texas, US | Columbus, Ohio, US | Indianapolis, Indiana, US | Ottawa, Ontario, CA | Winnipeg, Manitoba, CA | Seattle, Washington, US | Denver, Colorado, US | Nashville, Tennessee, US | Oklahoma City, Oklahoma, US | Boston, Massachusetts, US | Mississauga, Ontario, CA | Las Vegas, Nevada, US | Vancouver, British Columbia, CA | Atlanta, Georgia, US | Virginia Beach, Virginia, US | Miami, Florida, US | Arlington, Texas, US | Reno, Nevada, US | Chesapeake, Virginia, US | Richmond, Virginia, US | Arlington, Virginia, US | Savannah, Georgia, US | Boise, Idaho, US | Fairfax, Virginia, US
Related jobs
-
Senior Manager, AI Engineering USD 150K-187KAI Act | AI RMF | Agent Frameworks | Bias Testing | Deep learning401k match | EAP Coverage | Employee stock purchase plan | Hybrid work model | Medical/Dental/Vision insuranceSenior-level Full TimePrinceton, New Jersey, United States; San … R8h ago
-
Senior Software Engineer - AI Interaction Evaluator (Codex / Claude Code, up to $200/hr) USD 200K-400KClaude Code | Cursor | JavaScript | OpenAI Codex | PythonSenior-level Full TimeMiami R10h ago
-
AI Solutions Intern (4-Month Contract) CAD 56K-56KAI Studio | Azure | Azure AI | Azure AI Studio | Azure DevOpsEntry-level Contract Full Time InternshipVancouver, British Columbia, Canada R15h ago
-
Staff AI Scientist USD 170K-225KAdversarial Training | BERT | Data Generation | Data labeling | Dataset development401k plan | Annual events | CalTrain pass | Fastrak reimbursement | Fitness reimbursementSenior-level Full TimePalo Alto R16h ago
-
Senior AI Engineer USD 170K-190KAPI Gateway | AWS Lambda | Amazon API | Amazon API Gateway | Amazon AuroraCareer advancement | Employee assistance program | Employee recognition | LinkedIn Learning Platform | Open PTOSenior-level Full TimeRemote US R19h ago
-
AI Engineer (Remote) USD 169K-230KAWS | Agent systems | Application development | Automation | Azure401k plan | Accident insurance | Dental insurance | Disability insurance | Flexible spending accountExecutive-level Full TimeFort Washington, PA, United States R19h ago
-
Staff/Senior Agentic AI Engineers (Multiple roles) USD 180K-215KAPI Design | AWS | Agent Orchestration | Agentic AI | Cloud infrastructureSenior-level Full TimeSan Francisco, California R20h ago
-
ABAC | AWS CloudFormation | AWS Lambda | AWS Step Functions | AWS-APIsOnsite/hybrid workSenior-level Full TimeChantilly, Virginia R21h ago
-
Applied AI Engineer USD 130K-180KAI Safety | AI Security | API Design | AWS | Agent FrameworksCommuter benefits | Company equity | Fitness subsidies | Flexible work schedule | Health, dental, vision insuranceMid-level Full TimeSomerville, MA R22h ago
-
AI Developer Builder USD 140K-180KAWS | Agentic Systems | Anthropic Bedrock | Context pipelines | DatadogDirect input on roadmap | High ownershipSenior-level Full TimeTel Aviv-Yafo, Tel Aviv District, IL R23h ago
-
ML Engineer CAD 160K-180KA/B | A/B Testing | Anomaly Detection | B testing | BigQueryDental insurance | Health insurance | Hybrid work environment | Vision insuranceMid-level Full TimeVancouver R1d ago
-
AI Architect USD 184K-253KAgent Orchestration | Agent protocols | Autonomous Agents | Caching | Context ManagementDomestic travel up to 10% | Relocation not authorized | Remote US workSenior-level Full TimeUS, Pennsylvania, Pittsburgh, United States R1d ago
-
AI/ML Computer Science Research and Development Engineer USD 121K-231KAdversarial Machine Learning | Benchmarking | Computer Vision | Convolutional Neural Networks | Data PreprocessingSenior-level Full TimePenn State University Park, United States R1d ago
-
AI Developer USD 77K-176KAPI Development | Asynchronous Messaging | Audit Logging | Automated testing | CI/CDDependent care | Health insurance | Paid leave | Professional development | Remote or hybrid work optionsMid-level Full TimeUSA, OH, Beavercreek (3800 Pentagon Blvd), … R1d ago
-
AI Developer USD 77K-176KAsynchronous Messaging | Audit Logging | Automated testing | CI/CD | ContainerizationDependent care | Paid leave | Professional development | Tuition assistance | Work-life programsMid-level Full TimeUSA, OH, Beavercreek (3800 Pentagon Blvd), … R1d ago
-
AI Developer USD 77K-176KAsynchronous Messaging | Audit Logging | Automated testing | CI/CD | DevSecOpsDependent care | Disability insurance | Health insurance | Life insurance | Paid leaveMid-level Full TimeUSA, OH, Beavercreek (3800 Pentagon Blvd), … R1d ago
-
AI Developer USD 77K-176KAgentic Workflows | Asynchronous Messaging | Audit Logging | Automated testing | CI/CDDependent care | Disability insurance | Health insurance | Life insurance | Paid leaveMid-level Full TimeUSA, OH, Beavercreek (3800 Pentagon Blvd), … R1d ago
-
AI Developer USD 77K-176KAgentic Workflows | Asynchronous Messaging | Audit Logging | Automated testing | CI/CDDependent care | Paid leave | Professional development | Remote work flexibility | Tuition assistanceMid-level Full TimeUSA, OH, Beavercreek (3800 Pentagon Blvd), … R1d ago
-
AI & Analytics Engineer (Software Engineer – Full stack) USD 125K-135K.NET | ASP.Net Core | Agile | Angular | Automated testingEntry-level Full TimeRemote - United States, United States R1d ago
-
Associate Director, AI Software Security Engineer USD 157K-298KAI Assurance | Amazon Web Services | Cloud Security | Cloud platform | ComplianceRelocation eligibilityMid-level Full TimeUS-TX-MCKINNEY-513WM ~ 2501 W University Dr … R1d ago
-
Data Analytics Consultant - AI & Automation USD 110K-157KAI Agent | AI Agent Development | AI Services | API Integration | Agent DevelopmentFlexible work arrangements | Hybrid work schedule | Paid Holidays | Paid vacation | Parental leaveSenior-level Full TimePortland, OR, US R1d ago
-
Finance & Strategy AI Engineer USD 146K-246KAPI Integration | Adaptive Planning | Agentic Workflows | BigQuery | Data GovernanceFlexible remote work | Health benefits | Parental leave | Professional development stipendSenior-level Full TimeSan Francisco - SF9 R1d ago
-
Director of Product Strategy & Applied AI USD 234K-260KAgents SDK | Anthropic API | Azure OpenAI | Azure OpenAI API | ConfluenceExecutive-level Full TimeRemote- USA R1d ago
-
Enterprise Applied AI Solution Specialist USD 90K-130KAPI Integration | Agent Frameworks | Conversational Design | Data Governance | Function CallingMid-level Full TimeWeston,FL,United States R1d ago
-
Senior AI Data Engineer USD 118K-178KAI Agent | BigQuery | CRM | Customer Data | Customer Data PlatformFlexible working model | Health insurance | Parental leave | Professional development stipend | Remote workSenior-level Full TimeRemote - US R1d ago