Data Operations Manager, Knowledge

San Francisco, CA

Anthropic

Anthropic is an AI safety and research company that's working to build reliable, interpretable, and steerable AI systems.

View all jobs at Anthropic

Apply now Apply later

About Anthropic

Anthropic’s mission is to create reliable, interpretable, and steerable AI systems. We want AI to be safe and beneficial for our users and for society as a whole. Our team is a quickly growing group of committed researchers, engineers, policy experts, and business leaders working together to build beneficial AI systems.

About the Role

Anthropic is seeking an entrepreneurial Data Operations Manager to spearhead human data collection initiatives that directly power Claude's most advanced capabilities. You'll work across our Claude Skills, Knowledge, Safeguards, and Frontier Red Team to design, build, and scale complex data collection projects that push the boundaries of AI safety and capability research.

This is a highly strategic, 0-to-1 role designed for someone with startup founder mentality and operational excellence - think technical product manager or early-stage startup operator who thrives at the intersection of cutting-edge AI research and scalable execution. You'll create novel data collection methodologies, build processes from scratch, and solve complex challenges that directly improve Claude's reasoning, safety, and knowledge capabilities.

You will own "data as the product" for our most critical AI research initiatives, translating breakthrough research ideas into robust, scalable data collection systems that enable frontier model development while maintaining our commitment to safety and alignment.

About the Impact

As our Data Operations Manager, you'll be at the forefront of developing the data infrastructure that enables breakthrough advances in AI capabilities while ensuring safety and alignment. Your work will directly contribute to making AI systems more capable at complex reasoning and knowledge tasks while maintaining our commitment to beneficial AI development.

If you're excited about building something entirely new, have the technical intuition to understand complex AI systems, and possess the entrepreneurial drive to create scalable operations from the ground up, we'd love to hear from you.

Responsibilities

Strategic Leadership & Vision

  • Lead comprehensive data strategies for Claude Skills, Safety evaluations, and frontier capability assessment that directly impact model performance and safety
  • Drive strategic initiatives affecting data quality, operational efficiency, and research velocity across multiple teams
  • Collaborate with research leaders to understand complex technical requirements and translate them into scalable operational frameworks

Technical Infrastructure & Innovation

  • Design and build novel data collection systems and evaluation frameworks that enable rigorous measurement of AI capabilities and safety properties
  • Architect scalable, automated infrastructure for collecting, processing, and managing high-quality human feedback data
  • Develop sophisticated tooling and platforms that support complex human-AI interaction scenarios for knowledge tasks and safety evaluations

Cross-functional Partnership & Project Management

  • Partner with researchers, engineers, and product teams to scope complex projects, resolve technical blockers, and ensure seamless integration with training pipelines
  • Manage multiple complex, high-stakes projects simultaneously, balancing technical complexity with delivery timelines
  • Create analytics and measurement frameworks to make data-driven decisions about project prioritization and resource allocation

Operational Excellence & Scaling

  • Build and manage relationships with specialized contractors and vendors for highly technical data collection requirements
  • Implement robust quality control and verification processes to ensure data usability for training state-of-the-art AI systems
  • Establish processes that enable rapid iteration and experimentation while maintaining rigorous quality standards for safety-critical applications

You may be a good fit if you

  • Have 5+ years of experience in technical operations, product management, or similar roles with a proven track record of building complex systems from the ground up
  • Demonstrate entrepreneurial experience as a technical founder, early-stage startup operator, or in similar 0-to-1 leadership roles where you've built both processes and products
  • Have strong technical intuition for what makes high-quality training data for advanced AI systems and experience with AI systems, large language models, or evaluation frameworks
  • Possess exceptional project management skills with ability to coordinate complex technical initiatives across multiple teams
  • Are comfortable operating in highly ambiguous environments where you need to define both the "what" and the "how" from scratch
  • Have a strong product mindset for understanding user needs and translating them into operational requirements
  • Thrive in fast-paced research environments with shifting priorities and novel technical challenges
  • Are passionate about AI safety and understand the critical importance of high-quality data in building beneficial AI systems

Strong candidates may also have

  • Experience building or working with AI agents, evaluation systems, or advanced AI safety methodologies
  • Background in designing and implementing evaluation systems or human-in-the-loop workflows for large language models
  • Experience with agentic AI systems, computer use capabilities, or advanced reasoning assistance tools
  • Knowledge of AI safety evaluation, red teaming, constitutional AI, or related AI safety methodologies
  • Background in human-computer interaction (HCI), user experience design, or related fields with focus on optimizing human-AI collaboration
  • Experience in high-growth startup environments, particularly in technical roles that evolved to include operational responsibilities
  • Background collaborating with AI researchers or experience in research-oriented organizations
  • Technical expertise in areas like data pipelines, evaluation frameworks, or ML infrastructure

Role Specific Location Policy:

  • This role is based in San Francisco office; however, we are open to considering exceptional candidates for remote work on a case-by-case basis.

The expected salary range for this position is:

Annual Salary:$270,000—$290,000 USD

Logistics

Education requirements: We require at least a Bachelor's degree in a related field or equivalent experience.

Location-based hybrid policy:
Currently, we expect all staff to be in one of our offices at least 25% of the time. However, some roles may require more time in our offices.

Visa sponsorship: We do sponsor visas! However, we aren't able to successfully sponsor visas for every role and every candidate. But if we make you an offer, we will make every reasonable effort to get you a visa, and we retain an immigration lawyer to help with this.

We encourage you to apply even if you do not believe you meet every single qualification. Not all strong candidates will meet every single qualification as listed.  Research shows that people who identify as being from underrepresented groups are more prone to experiencing imposter syndrome and doubting the strength of their candidacy, so we urge you not to exclude yourself prematurely and to submit an application if you're interested in this work. We think AI systems like the ones we're building have enormous social and ethical implications. We think this makes representation even more important, and we strive to include a range of diverse perspectives on our team.

How we're different

We believe that the highest-impact AI research will be big science. At Anthropic we work as a single cohesive team on just a few large-scale research efforts. And we value impact — advancing our long-term goals of steerable, trustworthy AI — rather than work on smaller and more specific puzzles. We view AI research as an empirical science, which has as much in common with physics and biology as with traditional efforts in computer science. We're an extremely collaborative group, and we host frequent research discussions to ensure that we are pursuing the highest-impact work at any given time. As such, we greatly value communication skills.

The easiest way to understand our research directions is to read our recent research. This research continues many of the directions our team worked on prior to Anthropic, including: GPT-3, Circuit-Based Interpretability, Multimodal Neurons, Scaling Laws, AI & Compute, Concrete Problems in AI Safety, and Learning from Human Preferences.

Come work with us!

Anthropic is a public benefit corporation headquartered in San Francisco. We offer competitive compensation and benefits, optional equity donation matching, generous vacation and parental leave, flexible working hours, and a lovely office space in which to collaborate with colleagues.

Apply now Apply later
Job stats:  0  0  0

Tags: Anthropic Biology Claude Computer Science DataOps Data pipelines Data quality GPT GPT-3 LLMs Machine Learning ML infrastructure ML models Physics Pipelines Research

Perks/benefits: Career development Competitive pay Equity / stock options Flex hours Flex vacation Parental leave Startup environment

Region: North America
Country: United States

More jobs like this