Agent Evaluation & Evolution Machine Learning Engineer Graduate (AML-Ark-US) - 2027 Start
Seattle, Washington, United States
USD 121K-243K Entry-level Full Time
Tasks
- Analyze agent execution traces
- Build LLM benchmarks and judging pipelines
- Collaborate with research platform and product teams to deploy methods
- Design LLM agent evaluation systems
- Incorporate user feedback into system improvements
- Support closed loop improvement from experience to capability
Perks/Benefits
- N/A
Skills/Tech-stack
Benchmarking | Data Pipelines | Fine Tuning | Human evaluation | LLM Evaluation | Language Models | Language Processing | Large Language Models | Machine Learning | Model Fine-tuning | Model Inference | Model Training | Natural Language | Natural Language Processing | Prompt engineering
Education
N/A
Related jobs
-
Senior-level Full TimeAnnapolis Junction, United States R2h ago
-
Software Engineer, Parallel Scientific Computing USD 130K-190KBenchmarking | C++ | CUDA C++ | Computer Architecture | High PerformanceEntry-level Full TimeRedwood City2h ago
-
Entry-level Full TimeTel Aviv-Yafo, Tel Aviv District, IL2h ago
-
Palantir Engineer - AI and Data Science Engineer III USD 131K-218KArtificial Intelligence | Data Engineering | Data Modeling | Data Pipelines | Data TransformationActive secret clearanceSenior-level Full TimeHuntsville, Alabama, United States2h ago
-
Agent Evaluation & Evolution Machine Learning Engineer Intern (AML-Ark-US) - 2027 Summer USD 162K-316KAutomation | Benchmarking | Data Analysis | Language Models | Language ProcessingCareer development workshops | Hands-on projects | Industry exposure | Social eventsEntry-level InternshipSan Jose, California, United States3h ago
-
Visual Generation & Multimodal Evaluation Machine Learning Engineer Graduate (AML-Ark-US) - 2027 Start USD 128K-256KAutomated metrics | Computer Vision | Data Engineering | Data Pipelines | Deep learningEntry-level Full TimeSan Jose, California, United States3h ago
-
Visual Generation & Multimodal Evaluation Machine Learning Engineer Intern (AML-Ark-US) - 2027 Summer USD 153K-300KComputer Vision | Data Pipelines | Deep learning | Language Models | Large Language ModelsEntry-level InternshipSan Jose, California, United States3h ago
-
Data Lake Infrastructure & Data Analytics Research Engineer Graduate (AML-Ark-US) - 2027 Start USD 128K-256KAnalytics | Batch Processing | Data Engineering | Data Governance | Data LakeEntry-level Full TimeSan Jose, California, United States3h ago
-
Data Lake Infrastructure & Data Analytics Research Engineer Graduate (AML-Ark-US) - 2027 Start (PhD) USD 162K-316KBatch Processing | Data Engineering | Data Governance | Data Lake | Data QualityEntry-level Full TimeSan Jose, California, United States3h ago
-
Data Lake Infrastructure & Data Analytics Research Engineer Intern (AML-Ark-US) - 2027 Summer USD 128K-256KBatch Processing | Cloud Computing | Data Engineering | Data Governance | Data LakeDevelopment workshops | Industry exposure | Internship experience | Social eventsEntry-level InternshipSan Jose, California, United States3h ago
-
Autoscaling | Cluster management | Containerd | Disaster Recovery | DockerEntry-level InternshipSan Jose, California, United States3h ago
-
Autoscaling | Container Runtime | Disaster Recovery | Docker | ElasticityEntry-level Full TimeSeattle, Washington, United States3h ago
-
Agent Evaluation & Evolution Machine Learning Engineer Intern (AML-Ark-US) - 2027 Summer USD 162K-316KBenchmarking | Data Analysis | Deep learning | Language Models | Language ProcessingDevelopment workshops | Industry exposure | Learning programs | Social eventsEntry-level InternshipSeattle, Washington, United States3h ago
-
Visual Generation & Multimodal Evaluation Machine Learning Engineer Graduate (AML-Ark-US) - 2027 Start USD 121K-243KComputer Vision | Data pipeline | Deep learning | Fine Tuning | Language ModelsEntry-level Full TimeSeattle, Washington, United States3h ago
-
Visual Generation & Multimodal Evaluation Machine Learning Engineer Intern (AML-Ark-US) - 2027 Summer USD 153K-300KComputer Vision | Data pipeline | Deep learning | Image Generation | Language ProcessingDevelopment workshops | Industry exposure | Internship experience | Learning programs | Social eventsEntry-level InternshipSeattle, Washington, United States3h ago
-
Research Engineer, Data Lake Infrastructure & Data Analytics Graduate (AML-Ark-US) - 2027 Start (PhD) USD 153K-300KApache Flink | Apache Spark | Data Governance | Data Lake | Data QualityEntry-level Full TimeSeattle, Washington, United States4h ago
-
LLM AIOps Development Engineer - Data Center Networking USD 157K-256KBGP | CI/CD | ClickHouse | Deep learning | DockerMid-level Full TimeSan Jose, California, United States4h ago
-
LLM AIOps Development Engineer - Data Center Networking USD 157K-256KAgentic Systems | Anomaly Detection | BGP | CI/CD | Cause analysisMid-level Full TimeSeattle, Washington, United States4h ago
-
Autoscaling | Containerization | Disaster Recovery | FinOps | GPU resource managementEntry-level Full TimeSan Jose, California, United States4h ago
-
Software Engineer, Machine Learning USD 170K-251KAgent Orchestration | Automation | Bias Mitigation | Computer Vision | Data IntegritySenior-level Full TimeMenlo Park, CA5h ago
-
Telecom Conveyance Engineer, Data Center Infrastructure USD 144K-190K4D Construction | AI machine learning | AutoCAD | BIM | Cable TraySenior-level Full TimeMenlo Park, CA5h ago
-
API Integration | Access Control | Automated Evaluation | BigQuery | CassandraEquity compensation | Health insurance | Paid time off | Retirement planSenior-level Full TimeSunnyvale, CA, USA5h ago
-
Senior Software Engineer, AI/ML, Google Cloud Platforms USD 174K-252KC++ | Data Processing | Language Processing | ML Infrastructure | Machine LearningSenior-level Full TimeNew York, NY, USA; Sunnyvale, CA, …5h ago
-
Smart NIC Senior Software Engineer, Embedded USD 174K-252KAI machine learning | C# | C++ | Data Center Networks | Data centerSenior-level Full TimeRaleigh, NC, USA; Durham, NC, USA5h ago
-
Senior Data Application Engineer, Core USD 163K-236KCloud Data | Cloud data lakehouse | Data Contracts | Data Governance | Data LakehouseSenior-level Full TimeSan Jose, CA, USA5h ago