Human Data Lead

San Francisco

Full Time Senior-level / Expert USD 100K - 300K

Magic

Magic is an AI company that is working toward building safe AGI to accelerate humanity’s progress on the world’s most important problems.

View all jobs at Magic

Apply now Apply later

Posted 3 hours ago

Magic’s mission is to build safe AGI that accelerates humanity’s progress on the world’s most important problems. We believe the most promising path to safe AGI lies in automating research and code generation to improve models and solve alignment more reliably than humans can alone. Our approach combines frontier-scale pre-training, domain-specific RL, ultra-long context, and inference-time compute to achieve this goal.

About the role:

As the lead of our human data initiative, you will oversee large-scale human data projects, ensuring the collection, curation, and evaluation of high-quality data to support the development of Magic’s agents, foundation models and research.

What you might work on:

Oversee the design and implementation of infrastructure to collect, curate, and evaluate data from human experts and synthetic sources
Work closely with researchers to gather specialized datasets across various modalities, including code text, images, and tool actions
Develop scalable data collection methods
Create a high-level research roadmap to plan and prioritize future experiments and data collection strategies

What we’re looking for:

Exceptional attention to detail and ability to manage multiple large-scale projects simultaneously
Background in data science, with experience designing and running experiments, as well as operationalizing data collection processes and metrics
Technical expertise across ML and software engineering
Prior experience with large language models and understanding of how data affects both pre- and post-training

Magic strives to be the place where high-potential individuals can do their best work. We value quick learning and grit just as much as skill and experience.