Rust - Senior Engineer - AI Interaction Evaluator
Tasks
- Assess response usefulness and correctness at a high level
- Define criteria for great AI assisted engineering interactions
- Evaluate AI generated coding interactions end to end
- Evaluate quality of explanations and reasoning
- Provide direct opinionated feedback on interaction quality
Perks/Benefits
- N/A
Skills/Tech-stack
Claude Code | Cursor | JavaScript | OpenAI Codex | Python | TypeScript
Education
N/A
Roles
AI | AI Evaluation Engineer | Engineer | Evaluation Engineer | Software Engineer
Related jobs
-
LLM Engineer bei der JUST ADD AI (all genders) EUR 53K-59KAgent workflows | Fine Tuning | Hosting | LLM Fine-tuning | Language ModelsCoffee Included | E-learning reimbursement | Employee discounts | Fitness allowance | Flexible work optionsMid-level Full TimeBremen // Hamburg // Hybrid R10h ago
-
Lead Data Platform Engineer -6 Month Secondment GBP 85K-102KAPI Integration | AWS Glue | AWS Lake | AWS Lake Formation | AWS LambdaAnnual leave | Bank holidays | Healthcare | Pension | SharesaveSenior-level Full TimeNottingham, United Kingdom R11h ago
-
AI Evaluation | AI Observability | ASP.Net Core | AWS | Agentic Architectures401k matching | Continuing education | Flexible PTO | Health and wellness programs | Health, dental, and vision insuranceSenior-level Full TimeCanada R12h ago
-
Data Engineer Semi Senior USD 110K-188KAPI Authentication | BigQuery | Cloud Storage | Cloud platform | Data ModelingSenior-level Full TimeRemote job R13h ago
-
Ingeniero de Datos Senior 3468 USD 156K-226KBigQuery | Cloud Storage | Cloud platform | Data Modeling | Data PipelinesRemote work autonomy | Technical collaboration with business and engineering teamsSenior-level Full TimeRemote job R13h ago
-
AI Model Evaluation | AI model | AWS | Azure | Azure DataChildcare assistance | Continuous learning platform | Dental insurance | Discount club | Extended parental leaveSenior-level Full TimeBrazil R14h ago
-
Azure | CI/CD | Databricks | Git | GitHub100 percent remote | Childcare assistance | Continuous learning platform | Dedicated language learning platform | Dental insuranceMid-level Full TimeBrazil R14h ago
-
Senior Machine Learning Engineer, Payments USD 191K-223KAirflow | Anomaly Detection | Data Processing | Deep learning | Fine TuningSenior-level Full TimeRemote-USA R15h ago
-
AWS Glue | AWS Glue Data Catalog | AWS Lake | AWS Lake Formation | AWS LambdaContinuous professional development | Fully remote within Brazil | Technical mentorship | Technical ownershipMid-level Full TimeBrazil R16h ago
-
Senior Data Engineer (Data Architecture) USD 105K-135KAPIs | AWS Glue | Airflow | Azure Data | Azure Data Factory401k matching | Dental insurance | Extended holiday break | Flexible schedules | Life insuranceSenior-level Full TimeRemote, United States R17h ago
-
Data Engineer, Hardware Reliability (Starlink) USD 135K-185KBash | C# | C++ | Concurrency | Data InfrastructureExtended hours and weekends | Onsite work required | Travel up to 10%Mid-level Full TimeBastrop, TX R18h ago
-
Machine Learning Systems Engineer, Ads ML Platform GBP 90K-110KAnomaly Detection | Apache Airflow | Apache Flink | Apache Kafka | Apache SparkBike to work scheme | Family planning support | Flexible vacation | Gender-affirming care | Group personal pension scheme with employer matchMid-level Full TimeRemote - United Kingdom R18h ago
-
Data Engineer & Reporting Specialist - ICT Risk (f/m/d) CZK 720K-1143KCloud platform | Dashboarding | Data Ingestion | Data Modeling | Data PipelinesAccident insurance | Company share plan | E-learning access | Flexible benefits | Flexible working hoursMid-level Full TimePrague, CZ R18h ago
-
Machine Learning Engineer student for AI Solutions Group ILS 170K-230KArgo | Docker | Elastic | Generative AI | GitHybrid work model | Student internship arrangementNone Part TimeISR - Haifa, Israel R18h ago
-
Testing Engineering Specialist Advisor INR 2475K-3380K.NET | AI Search | AWS | Application Insights | AzureSenior-level Full TimeNoida, UP, IN R18h ago
-
Senior-level Full TimeRemote, KA, IN R18h ago
-
Senior-level Full TimeRemote, KA, IN R18h ago
-
Experienced AI Engineer / Data Scientist 1 EUR 37K-55KAdvanced Analytics | Amazon Web Services | Azure Foundry | Azure Machine Learning | Cloud ComputingDiscounts and subscriptions | Employee referral bonuses | Health insurance | Hybrid work | Life insuranceMid-level Full TimeVilnius, LT, LT-11341 R18h ago
-
Entry-level Full TimeGreece - Remote R18h ago
-
Systems Integration Specialist Advisor_Storage Cloud INR 800K-1099KAWS | Access Control | Automation | Block Storage | CI/CDMid-level Full TimeBangalore, KA, IN R18h ago
-
Control Algorithms Engineer PLN 206K-242KData Analysis | Digital Twin | Dynamic Systems | Firmware integration | Hardware-in-the-loopDiscounts on products and services | Extended paternity leave | Flexible work hours | Hybrid work environment | Insurance PolicySenior-level Full TimePL-ZAR-001, Poland R18h ago
-
Staff Software Engineer, Data Platform USD 231K-340KAWS | Access Control | Airbyte | Airflow | Anomaly DetectionSenior-level Full TimeNew York R18h ago
-
Staff Software Engineer, Data Platform USD 231K-340KAWS | Access Control | Airbyte | Amazon Redshift | Apache AirflowSenior-level Full TimeSan Francisco R18h ago
-
Sr. Staff Software Engineer, Big Data Platform USD 177K-364KAWS | Apache Flink | Apache Presto | Apache Spark | Data ProcessingIn office collaboration 1 to 2 times per quarterSenior-level Full TimePalo Alto; Seattle, WA; New York, … R18h ago
-
Member of Technical Staff, Platform USD 120K-200KAI Agents | API Design | Amazon Web Services | Cloud Computing | Cloud platformDental insurance | Equity | Flexible work schedule | Health insurance | Paid time offSenior-level Full TimeMountain View, CA R20h ago