C# Senior Engineer - AI Interaction Evaluator
Tasks
- Assess response usefulness and correctness at high level
- Assess trust building and user guidance
- Define quality rubric for strong engineer behavior
- Evaluate AI generated coding interactions end to end
- Evaluate explanation quality and reasoning
- Judge engineering judgment and interaction quality
- Provide opinionated feedback on what worked and what felt off
Perks/Benefits
Skills/Tech-stack
AI Assisted Development | Claude Code | Csharp | Cursor | JavaScript | OpenAI Codex | Prompt engineering | Python | TypeScript
Education
N/A
Roles
AI | AI Evaluator | Engineer | Evaluator | Software Engineer
Related jobs
-
LLM Engineer bei der JUST ADD AI (all genders) EUR 53K-59KAgent workflows | Fine Tuning | Hosting | LLM Fine-tuning | Language ModelsCoffee Included | E-learning reimbursement | Employee discounts | Fitness allowance | Flexible work optionsMid-level Full TimeBremen // Hamburg // Hybrid R11h ago
-
Lead Data Platform Engineer -6 Month Secondment GBP 85K-102KAPI Integration | AWS Glue | AWS Lake | AWS Lake Formation | AWS LambdaAnnual leave | Bank holidays | Healthcare | Pension | SharesaveSenior-level Full TimeNottingham, United Kingdom R11h ago
-
AI Evaluation | AI Observability | ASP.Net Core | AWS | Agentic Architectures401k matching | Continuing education | Flexible PTO | Health and wellness programs | Health, dental, and vision insuranceSenior-level Full TimeCanada R13h ago
-
Data Engineer Semi Senior USD 110K-188KAPI Authentication | BigQuery | Cloud Storage | Cloud platform | Data ModelingSenior-level Full TimeRemote job R13h ago
-
Ingeniero de Datos Senior 3468 USD 156K-226KBigQuery | Cloud Storage | Cloud platform | Data Modeling | Data PipelinesRemote work autonomy | Technical collaboration with business and engineering teamsSenior-level Full TimeRemote job R14h ago
-
AI Model Evaluation | AI model | AWS | Azure | Azure DataChildcare assistance | Continuous learning platform | Dental insurance | Discount club | Extended parental leaveSenior-level Full TimeBrazil R15h ago
-
Azure | CI/CD | Databricks | Git | GitHub100 percent remote | Childcare assistance | Continuous learning platform | Dedicated language learning platform | Dental insuranceMid-level Full TimeBrazil R15h ago
-
Senior Machine Learning Engineer, Payments USD 191K-223KAirflow | Anomaly Detection | Data Processing | Deep learning | Fine TuningSenior-level Full TimeRemote-USA R16h ago
-
AWS Glue | AWS Glue Data Catalog | AWS Lake | AWS Lake Formation | AWS LambdaContinuous professional development | Fully remote within Brazil | Technical mentorship | Technical ownershipMid-level Full TimeBrazil R17h ago
-
Senior Data Engineer (Data Architecture) USD 105K-135KAPIs | AWS Glue | Airflow | Azure Data | Azure Data Factory401k matching | Dental insurance | Extended holiday break | Flexible schedules | Life insuranceSenior-level Full TimeRemote, United States R17h ago
-
Data Engineer, Hardware Reliability (Starlink) USD 135K-185KBash | C# | C++ | Concurrency | Data InfrastructureExtended hours and weekends | Onsite work required | Travel up to 10%Mid-level Full TimeBastrop, TX R18h ago
-
Machine Learning Systems Engineer, Ads ML Platform GBP 90K-110KAnomaly Detection | Apache Airflow | Apache Flink | Apache Kafka | Apache SparkBike to work scheme | Family planning support | Flexible vacation | Gender-affirming care | Group personal pension scheme with employer matchMid-level Full TimeRemote - United Kingdom R18h ago
-
Data Engineer & Reporting Specialist - ICT Risk (f/m/d) CZK 720K-1143KCloud platform | Dashboarding | Data Ingestion | Data Modeling | Data PipelinesAccident insurance | Company share plan | E-learning access | Flexible benefits | Flexible working hoursMid-level Full TimePrague, CZ R19h ago
-
Machine Learning Engineer student for AI Solutions Group ILS 170K-230KArgo | Docker | Elastic | Generative AI | GitHybrid work model | Student internship arrangementNone Part TimeISR - Haifa, Israel R19h ago
-
Testing Engineering Specialist Advisor INR 2475K-3380K.NET | AI Search | AWS | Application Insights | AzureSenior-level Full TimeNoida, UP, IN R19h ago
-
Senior-level Full TimeRemote, KA, IN R19h ago
-
Senior-level Full TimeRemote, KA, IN R19h ago
-
Experienced AI Engineer / Data Scientist 1 EUR 37K-55KAdvanced Analytics | Amazon Web Services | Azure Foundry | Azure Machine Learning | Cloud ComputingDiscounts and subscriptions | Employee referral bonuses | Health insurance | Hybrid work | Life insuranceMid-level Full TimeVilnius, LT, LT-11341 R19h ago
-
Entry-level Full TimeGreece - Remote R19h ago
-
Systems Integration Specialist Advisor_Storage Cloud INR 800K-1099KAWS | Access Control | Automation | Block Storage | CI/CDMid-level Full TimeBangalore, KA, IN R19h ago
-
Control Algorithms Engineer PLN 206K-242KData Analysis | Digital Twin | Dynamic Systems | Firmware integration | Hardware-in-the-loopDiscounts on products and services | Extended paternity leave | Flexible work hours | Hybrid work environment | Insurance PolicySenior-level Full TimePL-ZAR-001, Poland R19h ago
-
AVP - Cloud Database Automation Engineer INR 2337K-3056KAWS RDS | Ansible | Auto Scaling | Cassandra | Cloud ConfigFlexible work hours | Work from homeExecutive-level Full TimeHyderabad IN, India R19h ago
-
Forward Deployed Engineer (Generative AI) USD 180K-230KAI Agent Builder | AI Pipelines | Agent Builder | Agent Developer Kit | Agentic designCareer development | Equal employment opportunities | Individual responsibilitySenior-level Full TimeAustin, Texas, United States - Remote R19h ago
-
Staff Software Engineer, Data Platform USD 231K-340KAWS | Access Control | Airbyte | Airflow | Anomaly DetectionSenior-level Full TimeNew York R19h ago
-
Staff Software Engineer, Data Platform USD 231K-340KAWS | Access Control | Airbyte | Amazon Redshift | Apache AirflowSenior-level Full TimeSan Francisco R19h ago