Sr Manager/Manager, AI Data Operations

Every day, tens of millions of people come to Roblox to explore, create, play, learn, and connect with friends in 3D immersive digital experiences– all created by our global community of developers and creators. 

At Roblox, we’re building the tools and platform that empower our community to bring any experience that they can imagine to life. Our vision is to reimagine the way people come together, from anywhere in the world, and on any device. We’re on a mission to connect a billion people with optimism and civility, and looking for amazing talent to help us get there. 

A career at Roblox means you’ll be working to shape the future of human interaction, solving unique technical challenges at scale, and helping to create safer, more civil shared experiences for everyone.

The mission of the Foundation AI group is to enable Roblox Creators to accelerate their workflows and to put AI in the hands of millions of users through their creations. We envision a future in which experiences on Roblox leverage generative text and speech capabilities to enable new forms of interactions in their experiences and generative 3D capabilities to allow new ways to create on the platform. 

Roblox is uniquely positioned with a vast amount of data on the platform that ranges from 3D and 4D creations, to player interactions within those creations. Roblox operates over 300 AI models all powered by this data, as we advance our AI efforts, we will be building scalable tooling, infrastructure and workflows to deepen our understanding of what is happening on that platform and then use that data to power creation, safety and discovery models.

The AI Data Operations team, provides data and insights that power machine learning and AI at the core of all Roblox products. As the leader for the team, you will define and drive the vision and strategy for data labeling and annotation programs end-to-end, work cross functionally to improve existing workflows, proactively surfacing insights and providing recommendations for product improvement, and actively engage with colleagues and partners to enhance the operational process across the organization. This Will report to the head of product for the AI groups at Roblox.

You will:

• Manage a team of data labelling project managers across all Roblox verticals.
• Manage multiple data labelling projects end-to-end including collaborating with research, product, engineering and data science teams to build training and test datasets.
• Coordinate with vendors, contractors and team members to ensure projects are accurate and complete
• Can take an abstract idea for a dataset and create a labeling workflow
• Help establish goals and work with multiple stakeholders on strategies for executing, measuring progress and reporting results. 
• Responsible for writing/reviewing a set of guidelines with examples. Can identify gray areas on the dataset and provide examples on how to address them
• Identify opportunities to improve operations and tooling and implement scalable solutions 
• Assess the quality of sourced and annotated data; Implement QA process. Review results, analyze quality, and runs audits
• Forecast timelines, track project process, communicate with partners, and delivers data along with quality report

You Have:

• 8+ years of experience in project/program management focused on building data pipelines and working within data labeling for machine learning
• Deep understanding of how ground-truth data can enhance machine learning models and In-depth understanding of data labeling workflow management
• Experience building project structure and timeline forecasting
• Experience managing vendor relationships or contractor workforces with great leadership
• Creativity: You take a creative and strategic approach to solving hard problems
• Able to get hands on when needed by diving into the data. 
• Bachelor's degree in technical or business discipline or equivalent experience
• Native/Fluent in Japanese, Korean, French, Portuguese, and/or Spanish (Bonus)

 

#LI-FO1
#LI-Onsite

For roles that are based at our headquarters in San Mateo, CA: The starting base pay for this position is as shown below. The actual base pay is dependent upon a variety of job-related factors such as professional background, training, work experience, location, business needs and market demand. Therefore, in some circumstances, the actual salary could fall outside of this expected range. This pay range is subject to change and may be modified in the future. All full-time employees are also eligible for equity compensation and for benefits.

Annual Salary Range$232,360—$290,580 USD

Roles that are based in our San Mateo, CA Headquarters are in-office Tuesday, Wednesday, and Thursday, with optional in-office on Monday and Friday (unless otherwise noted).

Roblox provides equal employment opportunities to all employees and applicants for employment and prohibits discrimination and harassment of any type without regard to race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state or local laws. Roblox also provides reasonable accommodations for all candidates during the interview process.