Engineering Expert (PhD) - AI Systems Evaluation
Tasks
- Annotate outputs
- Apply evaluation frameworks
- Assess explanation clarity
- Develop prompts
- Ensure response alignment
- Evaluate model responses
- Fact-check technical claims
Perks/Benefits
Skills/Tech-stack
AI research | Annotation | Communication | Evaluation methods | Factual verification | Language Models | Large Language Models | Prompt engineering | Structured evaluation | Structured evaluation methods | Technical assessment
Education
Related jobs
-
Data Platform Engineer USD 235K-376KCI/CD | Data Contracts | Data Modeling | Data Products | Data pipelineCell phone reimbursement | Health/Dental/Vision | Learning & development stipend | Mental Health & Wellness | PTOMid-level Full TimeSan Francisco, CA • New York, … R12h ago
-
Senior Software AI Engineer USD 149K-186K.NET | AWS | Agentic Systems | Cloud Computing | Code review401k match | Commuter benefits | Fertility and Family Planning Programs | Fitness benefits | Health insuranceSenior-level Full TimeRemote US R12h ago
-
Forward Deployed AI Product Engineer USD 155K-210KAI Agents | APIs | AWS | Azure | CI/CDAutonomy | Flexible work environment | On site client collaboration | Remote-first culture | Travel opportunitiesSenior-level Full TimeUS-Remote R15h ago
-
Senior Machine Learning Engineer, Payments USD 191K-223KAirflow | Cost monitoring | Deep learning | Drift monitoring | Fine TuningSenior-level Full TimeRemote-USA R17h ago
-
Senior AI Engineer - Grafana Ops, AI/ML | USA | Remote USD 154K-185KAWS | Agent Frameworks | Agent workflows | Azure | Cloud Computing100 percent remote | Bonus | Company funded AI coding assistant usage budget | Equity | Global annual leave policySenior-level Full TimeUnited States (Remote) R18h ago
-
Machine Learning Engineer - Evaluation USD 120K-235KBenchmarking | Bias detection | Evaluation methodology | Experiment design | Fine TuningBonus | Comprehensive benefits package | Equity compensationMid-level Full TimeHybrid in Santa Clara, CA R23h ago
-
Senior AI and LLM Engineer USD 184K-356KData-driven | Data-driven metrics | Deep learning | Generative AI | Language ModelsEquity | Hybrid workSenior-level Full TimeUS, CA, Remote, United States R1d ago
-
AI/ML Engineer (Senior Associate) - Remote USD 130K-188KAPI Development | AWS | Autogen | Azure | CI/CDDental insurance | Medical insurance | Remote work | Travel as needed | Vision insuranceSenior-level Full TimeChicago - 550 Van Buren, United … R1d ago
-
Senior Software Engineer (Hybrid) - 28172 USD 165K-240KAWS | Anthropic API | Azure | Function Calling | Git401k benefit | Education/training allowances | Generous PTO | Hybrid work flexibility | Paid HolidaysSenior-level Full TimeColumbia, MD, Maryland, United States R1d ago
-
Junior Software Engineer (Hybrid) - 28171 USD 90K-120KAI Observability | API Design | AWS | Agile | Anthropic401k matching | Dental insurance | Education/training allowances | Health insurance premium paid | Hybrid work environmentEntry-level Full TimeColumbia, MD, Maryland, United States R1d ago
-
AI Engineer USD 53K-119KAPI Design | Cost Optimization | Embeddings | Evaluation | JSONDental insurance | Gym stipend | Health insurance | Medical membership | Offsite retreatsSenior-level Full TimeRemote, US R1d ago
-
Machine Learning Engineer, Chakra USD 120K-235KAgentic AI | Benchmarking | Conversational AI | Data Pipelines | Deep learningMid-level Full TimeHybrid in Santa Clara, CA R1d ago
-
AVP of Data Platform – AI Agentic Solutions USD 127K-313KAzure DevOps | CI/CD | Data Lineage | Data Loss Prevention | Data Quality401k | Generous PTO | Hybrid schedule | Longevity bonuses | Medical, dental, and visionExecutive-level Full TimeWilkes Barre, PA, United States R2d ago
-
A2A | ABAC | Agent Orchestration | Agent systems | Arize PhoenixSenior-level Full TimeNY Manhattan (Office) - JPS, United … R2d ago
-
AI Deployment Engineer USD 160K-224KAgent Framework | Authentication | Container Orchestration | Data Pipelines | Distributed SystemsSenior-level Full TimeUnited States - Remote R2d ago
-
Forward Deployed Engineer USD 153K-222KAI Agent | AI Agent Frameworks | API Integration | Agent Frameworks | Agent systemsCustomer-facing role | Hybrid work environmentSenior-level Full TimeUnited States - Remote R2d ago
-
Senior Applied Scientist USD 164K-313KComputer Vision | Diffusion Models | Distributed Training | Language Models | Large Language ModelsSenior-level Full TimeSeattle, United States R2d ago
-
Machine Learning (ML) Bioengineer USD 146K-222KActive Learning | Bioinformatics | Data Analysis | Deep learning | Distributed Training401k | Education reimbursement program | Flexible schedule | Hybrid work schedule | Relocation assistanceMid-level Full TimeLivermore, CA, United States R2d ago
-
Senior Python Engineer USD 200K-225KAPI Design | AWS | Cloud infrastructure | Data Pipelines | Debugging401k plan | Company Offsites and Team Gatherings | Equity stock options | Flexible PTO | Medical, dental, and visionSenior-level Full TimeRemote - USA R2d ago
-
Staff Software Engineer, AI/ML USD 136K-265KAutogen | Cloud Platforms | CrewAI | Embeddings | Generative AIContinuous learning | Remote work | Vacation packageSenior-level Full TimeRemote - USA, United States R3d ago
-
2026 AI/ML Intern - Machine Learning Engineer USD 90K-110KAgent Orchestration | Agent systems | Agentic Workflows | Computer Vision | Data PipelinesCareer development | MentorshipEntry-level Full Time InternshipSan Jose, United States R3d ago
-
Senior AI Engineer USD 150K-210KAPI Integration | Cloud Native | Cloud Native Services | Container Orchestration | EmbeddingsBenefits | Equity | High-trust work environment | MentorshipSenior-level Full TimeSF Bay Area (Hybrid) R3d ago
-
Head of AI Sales USD 200K-300KAgent Orchestration | Agent systems | Anthropic | Apollo | Artificial Intelligence401k match | Dental | Disability insurance | EAP | ESPPExecutive-level Full TimeChicago (35 W. Wacker Dr.); Remote … R3d ago
-
Machine Learning Engineer, AI Search - USDS USD 145K-250KComputer Vision | Deep learning | Generative AI | Language Models | Language ProcessingMid-level Full TimeSan Jose, California, United States R3d ago
-
Senior-level Full TimeSan Jose, United States R4d ago