Engineering Expert (PhD) - AI Systems Evaluation
Tasks
- Annotate outputs
- Apply evaluation frameworks
- Assess explanation clarity
- Develop prompts
- Ensure response alignment
- Evaluate model responses
- Fact-check technical claims
Perks/Benefits
Skills/Tech-stack
AI research | Annotation | Communication | Evaluation methods | Factual verification | Language Models | Large Language Models | Prompt engineering | Structured evaluation | Structured evaluation methods | Technical assessment
Education
Related jobs
-
AI Engineer (Hybrid @ Bellevue, WA or Remote @ Florida) USD 140K-160KAWS | Artificial Intelligence | Asyncio | Evals | Function Calling401k match | Disability benefits | Family leave | Health insurance | Life insuranceEntry-level Full TimeHybrid @ Bellevue, WA or Remote … R1d ago
-
Staff AI Engineer USD 210K-235KAgent systems | Agentic AI | Anthropic API | Anthropic Claude | Automated Evaluation401k | Career growth | Disability and life insurance | Equipment provided | Flexible vacation policySenior-level Full TimeRemote (United States) R2d ago
-
Data Science AI Engineer, Advisor USD 117K-168KAWS | Azure | CMS | Cloud platform | Computer Vision401k employer match | Educational assistance | Flexible vacation policy | Fully remote | Health benefitsMid-level Full TimeAny city, NC, US, 99999 R2d ago
-
Principal AI/ML Engineer - AdTech USD 300K-400KAWS | Ad Exchanges | Apache Kafka | Apache Spark | CassandraEmployee discounts | Employee equity | Medical, dental & vision coverage | Pet insurance | Unlimited PTOSenior-level Full TimeRemote - United States R2d ago
-
Lead AI Engineer USD 200K-215KA/B | A/B Testing | AWS Bedrock | Agentic LLM | Agentic LLM systemsDental insurance | Employee discounts | Employee equity | Health insurance | Pet insuranceSenior-level Full TimeRemote - United States R2d ago
-
Senior Machine Learning Engineer USD 198K-287KArtificial Intelligence | Data Engineering | Fine Tuning | Foundation Models | GenAISenior-level Full TimeRemote - US R2d ago
-
GenAI Principal Engineer - Remote USD 145K-215KAI orchestration | API first | API-first design | AWS | Android401k matching | DEI focus | Development opportunities | Flexible schedule | Flexible time offSenior-level Full TimeUnited States, UNITED STATES, United States R2d ago
-
Senior Machine Learning Engineer USD 150K-200KDistributed Systems | Feature Engineering | Feature Selection | Language Models | Language Processing401k matching | Cell phone and internet stipend | Employee stock purchase plan | Flexible time off | Learning programsSenior-level Full TimeRemote - USA R2d ago
-
Agentic AI Engineering Intern USD 48K-86KAgent systems | Autogen | Automated testing | CI/CD | CrewAIEntry-level Full Time Internship6314 Remote/Teleworker US, United States R3d ago
-
AI Engineer USD 91K-175KAI Studio | AWS | Apache Spark | Azure | Azure AIHealth benefits | Incentive programs | Professional development | Remote work | Retirement benefitsSenior-level Full TimeWork at Home - Cincinnati - … R3d ago
-
AI Solutions Engineer, Global USD 130K-135KAI Services | Agentic Systems | Artificial Intelligence | Automated testing | Azure AI401k with company match | Employee assistance | Employee recognition | Life and AD D | Long-term disabilityMid-level Full TimeRemote - CO, United States R3d ago
-
Gen AI Engineer USD 132K-230KAWS ECS | AWS EKS | AWS Lambda | AWS Step Functions | Adversarial promptsHybrid work modelSenior-level Full TimeNew York/Dallas/Remote, NY, US R3d ago
-
AI Engineer USD 69K-125KAPI Integration | Autogen | Bias Mitigation | CUDA | ContainerizationSecret clearanceMid-level Full Time6314 Remote/Teleworker US, United States R3d ago
-
3803-AI Forward Deployed Engineer USD 117K-168KAI Agents | API Integration | AWS | Autogen | AzureDental insurance | Discounted Legal Aid | Health insurance | Life insurance | Long-term disabilityMid-level Full TimeUnited States - Remote R3d ago
-
Senior AI Solution Engineer USD 160KAI workflows | API Integration | Agentic Systems | Automation | Data CurationRemote work | Significant onsite travelSenior-level Full TimeRemote (United States) R3d ago
-
Senior AI/ML Engineer USD 125K-157KAI platforms | AWS | Agentic AI | Agentic AI Platforms | Data GovernanceDental insurance | Disability plans | Employee referral program | Fertility benefits | Life insuranceSenior-level Full TimeUS Remote R3d ago
-
Staff Applied AI Engineer - Pre-Sales USD 190K-330KAgent architectures | Data Processing | Fine Tuning | GenAI | LLMCareer growth opportunities | Equity | Remote work optionsSenior-level Full TimeNew York City, NY (Hybrid); Redwood … R3d ago
-
Staff Machine Learning Engineer - Content and Contributor Intelligence (Remote - United States) USD 112K-269KAWS Bedrock | Automation | Batch Processing | C++ | Computer VisionCareer development | Collaborative team environment | Fully remote option | MentorshipSenior-level Full TimeSan Francisco, CA, United States R3d ago
-
AI Model Evaluation | AI model | Data Analysis | Language Models | Large Language ModelsMid-level Freelance Part TimeUnited States R4d ago
-
AI Engineer III USD 118K-230KA2A | AI Foundry | Agent communication | Agent communication protocols | Agent evaluation401k employer match | Employee assistance programs | Employee recognition program | Health and wellness resources | Life and disability insuranceSenior-level Full TimeWA Western Telecommuter, United States R4d ago
-
AI Knowledge Data Engineer (Europe) USD 180K-240KAirflow | Data Curation | Data Lineage | Data Pipelines | Data Versioning401k matching | Dental insurance | Health insurance | Paid time off | Vision insuranceSenior-level Full TimeRemote - Fort Lauderdale, Florida, United … R4d ago
-
Senior-level Full TimeVirginia - Remote Office, United States R4d ago
-
Data Engineer USD 157K-190KAPIs | Cloud Platforms | Collaboration | Communication | Data ModelingCoworking subscription | Dental insurance | Flexible holiday schedule | Health insurance | Home office stipendMid-level Full TimeUnited States R4d ago
-
Senior Full-Stack Engineer II - AI/ML USD 184K-231KAI | API Standards | Cloud Architecture | Computer Vision | GoCareer development | Employee assistance program | Equity compensation | Flexible time off | Local meetupsMid-level Full TimeSeattle R4d ago
-
Senior Full-Stack Engineer II - AI/ML USD 184K-231KAI | API Design | Computer Vision | Go | Inference EnginesCareer development | Employee assistance | Employee stock purchase | Equity | Flexible time offMid-level Full TimeDenver R4d ago