Senior Software Engineer - AI Interaction Evaluator (Codex / Claude Code, up to $200/hr)
Tasks
- Assess response correctness at a high level
- Assess response usefulness
- Define quality standards for engineering taste
- Differentiate response quality levels
- Evaluate AI generated coding interactions end to end
- Evaluate alignment with how strong engineers think
- Judge explanation quality and reasoning
- Provide opinionated feedback on what did not work
- Provide opinionated feedback on what worked
Perks/Benefits
- N/A
Skills/Tech-stack
AI Assisted Development | Claude Code | Cursor | JavaScript | OpenAI Codex | Prompt engineering | Python | TypeScript
Education
N/A
Roles
AI | AI Engineer | Engineer | Senior Software Engineer | Software Engineer
Regions
Africa | Asia/Pacific | Europe | Middle East | North America | South America
Countries
Albania | Argentina | Austria | Bangladesh | Bolivia | Bosnia and Herzegovina | Brazil | Bulgaria | Cambodia | Canada | Chile | Colombia | Croatia | Czechia | Ecuador | Estonia | Finland | Germany | Greece | Hungary | India | Indonesia | Kosovo | Latvia | Lithuania | Malta | Montenegro | Morocco | North Macedonia | Paraguay | Philippines | Portugal | Romania | Serbia | Slovakia | Spain | Turkey | United States | Uruguay
States
Tirana, AL | Buenos Aires F.D., AR | Entre Rios, AR | Buenos Aires, AR | Santa Fe, AR | Cordoba, AR | Vienna, AT | Federation of B&H, BA | Dhaka Division, BD | Chittagong, BD | Khulna Division, BD | Sofia-Capital, BG | Santa Cruz Department, BO | Oruro, BO | La Paz Department, BO | Cochabamba, BO | Pernambuco, BR | Pará, BR | Ceará, BR | São Paulo, BR | Rio Grande do Sul, BR | Rio de Janeiro, BR | Minas Gerais, BR | Goiás, BR | Bahia, BR | Amazonas, BR | Alberta, CA | British Columbia, CA | Manitoba, CA | Ontario, CA | Quebec, CA | Valparaíso, CL | Valle del Cauca Department, CO | Santander Department, CO | Quindío Department, CO | La Guajira Department, CO | Huila Department, CO | Bolívar, CO | Bogota D.C., CO | Atlántico, CO | Antioquia, CO | Prague, CZ | Berlin, DE | Pichincha, EC | Guayas, EC | Azuay, EC | Harjumaa, EE | Madrid, ES | Uusimaa, FI | Attica, GR | Zagreb, HR | Budapest, HU | North Sumatra, ID | South Sumatra, ID | South Sulawesi, ID | Riau, ID | Lampung, ID | East Java, ID | Central Java, ID | West Java, ID | Jakarta, ID | Banten, ID | Riau Islands, ID | West Bengal, IN | Uttar Pradesh, IN | Telangana, IN | Tamil Nadu, IN | Rajasthan, IN | Punjab, IN | Maharashtra, IN | Madhya Pradesh, IN | Karnataka, IN | Jammu and Kashmir, IN | Haryana, IN | Delhi, IN | Bihar, IN | Andhra Pradesh, IN | Chhattisgarh, IN | Jharkhand, IN | Siem Reap, KH | Phnom Penh, KH | Vilnius, LT | Riga, LV | Rabat-Salé-Kénitra, MA | Casablanca-Settat, MA | Marrakesh-Safi, MA | Podgorica, ME | Grad Skopje, MK | Safi, MT | Valletta, MT | Metro Manila, PH | Lisbon, PT | Porto, PT | San Pedro Department, PY | Alto Paraná, PY | Asunción, PY | București, RO | Central Serbia, RS | Bratislava Region, SK | İzmir Province, TR | Ankara, TR | Istanbul, TR | District of Columbia, US | Florida, US | Georgia, US | Oklahoma, US | Tennessee, US | Texas, US | Illinois, US | Indiana, US | Ohio, US | Colorado, US | Nevada, US | Idaho, US | Washington, US | Pennsylvania, US | Virginia, US | Montevideo Department, UY | Florida, UY | Pristina, XK
Cities
Istanbul, Istanbul, TR | Dhaka, Dhaka Division, BD | Bogotá, Bogota D.C., CO | Hyderābād, Telangana, IN | Chattogram, Chittagong, BD | Casablanca, Casablanca-Settat, MA | Ankara, Ankara, TR | Madrid, Madrid, ES | Buenos Aires, Buenos Aires F.D., AR | Quito, Pichincha, EC | Guayaquil, Guayas, EC | Salvador, Bahia, BR | Gazipur, Dhaka Division, BD | Toronto, Ontario, CA | İzmir, İzmir Province, TR | Cali, Valle del Cauca Department, CO | Depok, West Java, ID | La Paz, La Paz Department, BO | Medellín, Antioquia, CO | Bucharest, București, RO | Santa Cruz de la Sierra, Santa Cruz Department, BO | Budapest, Budapest, HU | Vienna, Vienna, AT | Rabat, Rabat-Salé-Kénitra, MA | Philadelphia, Pennsylvania, US | Phnom Penh, Phnom Penh, KH | Khulna, Khulna Division, BD | Asunción, Asunción, PY | San Antonio, Texas, US | Córdoba, Cordoba, AR | Dallas, Texas, US | Belgrade, Central Serbia, RS | Montevideo, Montevideo Department, UY | Barranquilla, Atlántico, CO | Prague, Prague, CZ | Sofia, Sofia-Capital, BG | Howrah, West Bengal, IN | Edmonton, Alberta, CA | Marrakesh, Marrakesh-Safi, MA | Srinagar, Jammu and Kashmir, IN | Jacksonville, Florida, US | Rosario, Santa Fe, AR | Austin, Texas, US | Jodhpur, Rajasthan, IN | Cartagena, Bolívar, CO | Columbus, Ohio, US | Cochabamba, Cochabamba, BO | Ottawa, Ontario, CA | Kota, Rajasthan, IN | Riga, Riga, LV | Sarajevo, Federation of B&H, BA | Nashville, Tennessee, US | Raipur, Chhattisgarh, IN | Athens, Attica, GR | Zagreb, Zagreb, HR | Helsinki, Uusimaa, FI | Cuenca, Azuay, EC | Las Vegas, Nevada, US | Vancouver, British Columbia, CA | Mar del Plata, Buenos Aires, AR | Pristina, Pristina, XK | Vilnius, Vilnius, LT | Lisbon, Lisbon, PT | Skopje, Grad Skopje, MK | Atlanta, Georgia, US | Miami, Florida, US | Bratislava, Bratislava Region, SK | Tirana, Tirana, AL | Tallinn, Harjumaa, EE | Ciudad del Este, Alto Paraná, PY | Paraná, Entre Rios, AR | Podgorica, Podgorica, ME | Richmond, Virginia, US | Nārāyanganj, Dhaka Division, BD | Oruro, Oruro, BO | Arlington, Virginia, US | La Plata, Buenos Aires, AR | Savannah, Georgia, US | Siem Reap, Siem Reap, KH | Santa Cruz, Metro Manila, PH | San Antonio, Valparaíso, CL | Rāipur, Chittagong, BD | Montenegro, Quindío Department, CO | Albania, La Guajira Department, CO | Fairfax, Virginia, US | Santo Domingo, Antioquia, CO | Salvador, Madrid, ES | Lima, San Pedro Department, PY | Bolívar, Santander Department, CO | Colombia, Huila Department, CO | Valletta, Valletta, MT
Related jobs
-
Featured Feat. Principal Knowledge & Data Architect USD 174K-284KAWS Neptune | Canonicalization | Chunking | Cypher | DBTBenefits including health and wellness programs | Health, wellness, and retirement plansSenior-level Full TimeHeadquarters - Chevy Chase, MD R4d ago
-
Featured Feat. Associate Director, Data Labs USD 167K-167KAWS | Cloud Computing | Compute Infrastructure | Data Analysis | LLM GovernanceConference speaking opportunities | Hybrid work schedule | Media appearancesSenior-level Full TimeWashington, District of Columbia, 20004, United … R18d ago
-
Data Analytics Professional INR 1200K-2000KAWS Glue | AWS Lambda | Amazon Athena | Amazon S3 | Apache AirflowMid-level Full TimeBengaluru, IN, 5601035h ago
-
Principal Business Systems Analyst 2 INR 3700K-5000KApache Hadoop | Apache Spark | Azure DevOps | Big Data | CNNSenior-level Full TimeBengaluru, KA, IN5h ago
-
Embedded Test Engineer INR 660K-1200KArtifactory | Bitbucket | C# | C++ | CI/CDAdditional Paid Leave Volunteering | Flexible hours | Health insurance | Home working | On-demand trainingMid-level Full TimeChennai, TN, IN, 6000975h ago
-
AWS Data Engineering Advisor USD 117K-179KAWS | AWS Batch | AWS Glue | AWS Secrets | AWS Secrets Manager401k retirement savings plan | ESPP | Employer-paid disability insurance | Health, dental, and vision insurance | HolidaysSenior-level Full TimeHOUSTON, US, 770565h ago
-
Junior Data AWS Engineer / AI Engineer EUR 28K-35KAWS Glue | AWS IAM | AWS Lambda | AWS S3 | AWS SDKAWS certification training | Continuous learning | Professional growth plan | Stable employmentEntry-level Full TimeMadrid, MD, Spain6h ago
-
.NET | AI Foundry | AI Search | Agile | App ServiceChildcare support | Dental care | Flexible working hours | Hybrid work | Meal vouchersMid-level Full TimeValencia, Spain6h ago
-
Lead Data Platform Engineer EUR 65K-80KAgile | Analytics Workspace | Azure Architecture | Azure DevOps | Azure MonitorCareer development opportunities | Employee sickness or health insurance fund membership | Flexible work arrangements | Leisure time accident insurance | Occupational health careSenior-level Full TimeEspoo, FI6h ago
-
Data Engineer INR 3000K-4000KAmazon S3 | Databricks | ELT | ETL | PythonBike to work | Career mentorship | Employee assistance programme | Employee discount | Fitness classesSenior-level Full TimeBengaluru, KA, India7h ago
-
Senior Software Engineer INR 2475K-3465KCI/CD | Database performance | Database performance tuning | Exception Handling | FastAPIEmployee assistance program | Flexible working environment | LinkedIn Learning | Volunteer time offSenior-level Full TimeChennai, TN, India8h ago
-
Agent systems | Artificial Intelligence | Knowledge Base | Language Processing | Machine LearningCommunication in Czech | Full time remote 3 days per week | Hybrid work | Online and onsite interview process | Team collaborationSenior-level Contract Full TimeHybrid / Praha - Pankrác R8h ago
-
Bash | Data Processing | Docker | GCP | Infrastructure as CodeAsynchronous culture | Bonus | Equity | Friendly atmosphere | Remote-friendly environmentMid-level Full TimeSeattle, WA, USA8h ago
-
Bash | Cloud platform | Data Processing | Docker | Google CloudAsynchronous culture | Portfolio and LinkedIn application support | Remote-friendlyMid-level Full TimeChicago, IL, USA8h ago
-
Bash | Cloud platform | Data Ingestion | Data Ingestion Pipelines | Data ProcessingAsynchronous culture | Diverse and inclusive workplace | Laid-back atmosphere | Portfolio support | Remote-friendlyMid-level Full TimeMunich, Germany8h ago
-
Bash | Data Processing | Docker | GCP | Large Scale DataAsynchronous culture | Career growth opportunity | Collaborative entrepreneurial environment | Mission impact | Remote-friendly, distributed teamMid-level Full TimeToronto, Canada8h ago
-
Ablation Studies | Active Learning | Adversarial Testing | Attention Mechanisms | BPEFlexible work arrangements | Fully remote | Inclusive collaborative environment | Professional growthMid-level Full TimeBrazil R8h ago
-
API Management | AWS | Apigee | Bash | CI/CDFlexible work arrangements | Fully remote | Inclusive collaborative environment | Professional growth opportunitiesSenior-level Full TimeBrazil R8h ago
-
Senior-level Full Timebangalore, India8h ago
-
Bash | Cloud platform | Data Processing | Docker | Google CloudAsynchronous work culture | Flexible, hands-off management | Opportunity to build accessible learning products | Remote or distributed teamMid-level Full TimeSan Francisco, CA, USA9h ago
-
Bash | Cloud platform | Data Processing | Docker | GCPAsynchronous culture | Bonus opportunities | Flexible management approach | Remote workMid-level Full TimeDallas, TX, USA9h ago
-
Bash | Cloud platform | Data Processing | Docker | Google CloudAsynchronous culture | Bonus | Competitive compensation | Equity | Remote-friendlyMid-level Full TimeWashington, DC, USA9h ago
-
Bash | Cloud platform | Data Processing | Docker | Google CloudAsynchronous culture | Friendly work environmentMid-level Full TimeRedmond, WA, USA9h ago
-
Bash | Data Processing | Docker | GCP | LinuxAsynchronous culture | Bonus | Equity | Friendly work environment | Remote/distributed workMid-level Full TimeScottsdale, AZ, USA9h ago
-
Bash | Data Processing | Docker | GCP | Infrastructure as CodeAsynchronous work culture | Career growth | Collaborative team | Remote-friendlyMid-level Full TimePlano, TX, USA9h ago