Sr Manager, Data Science - GenAI & Labeling Platforms

About Pinterest:  

Millions of people across the world come to Pinterest to find new ideas every day. It’s where they get inspiration, dream about new possibilities and plan for what matters most. Our mission is to help those people find their inspiration and create a life they love. In your role, you’ll be challenged to take on work that upholds this mission and pushes Pinterest forward. You’ll grow as a person and leader in your field, all the while helping Pinners make their lives better in the positive corner of the internet.

Creating a life you love also means finding a career that celebrates the unique perspectives and experiences that you bring. As you read through the expectations of the position, consider how your skills and experiences may complement the responsibilities of the role. We encourage you to think through your relevant and transferable skills from prior experiences.

Our new progressive work model is called PinFlex, a term that’s uniquely Pinterest to describe our flexible approach to living and working. Visit our PinFlex landing page to learn more. 

Pinterest brings millions of people the inspiration to create a life they love. To evolve this mission our product and engineering teams need to innovate - much of this innovation is driven through machine learning, and critical to understanding how innovation on the product will change our business is through measurement. Data labels play a key role in unlocking both of these, and the rate and scale at which we can obtain reliable labels limits our speed of innovation.

 

This role brings together 3 critical science efforts:

• The notion of asking qualified raters to answer questions about content, whether it’s scoring its relevance to a particular context, review captions for pins, or determining whether or where certain attributes are present in an image, has played a critical role in our evaluation and machine learning efforts across Pinterest. However, utilizing human evaluators to complete these tasks at scale have limitations - it can be time-intensive to accurately define the tasks, costly to get large volumes of labels, and slow to collect the data. 
• Surveys of our Pinners offer a unique mechanism to gather the perspective of our Pinners on questions we have about the platform and content; a Pinner’s perspective can be different to that of a human rater observing the same content because of the unique context they possess.
• Advancements in Generative AI have opened up a wealth of opportunities for improvements in productivity, and we’ve only scratched the surface of its capabilities in the labeling space. Early results show strong promise for the role it can play in these tasks, reducing the time and cost of our labeling efforts, focusing our surveys and human rater efforts on higher value problems, and improving the accuracy of our learnings.

 

We’re looking for an accomplished Data Science leader to lead a small, high-performing team, to unlock a new level of capabilities in our efforts across labeling, surveys, and iterative GenAI tasks. From statistical approaches that can better inform the labels we collect to prototypes to automatically craft prompts for LLMs to address the needed tasks, this team will lead a key strategic component of the data science organization innovating on data platforms across the company.

 

What you’ll do:

We are looking for an experienced and highly capable Data Scientist to help us drive step function improvements in our data labeling capabilities at Pinterest. In this role, you will:

• Create and realize a strategic vision for the science investments across the labeling, survey and GenAI tooling space, emphasizing rigor alongside value-creation, and partner with product and engineering leaders to build a unified vision for these platforms.
• Build, inspire and grow a small high performing team of data scientists who are passionate about this space that will shape and execute on the strategic vision.
• Apply deep scientific knowledge and domain expertise to understand opportunities and prototype solutions that demonstrate substantial improvements in velocity, accuracy and cost-efficiency, measure and mitigate biases, and amplify the impact employees can have when utilizing survey results, data labels, or GenAI prompts in their investments.
• Translate ambiguous business challenges into actionable plans and ensure that your team is consistently producing trustworthy and high-quality technical output that influence the business.
• Communicate complex analytical findings and insights to both technical and non-technical audiences in a clear and concise manner.
• Collaborate cross-functionally with customers to understand their problems and pain-points, and with engineers to scale successful prototypes to become integral components of the platform.

 

What we’re looking for:

• 10+ years of combined post-graduate academic and industry experience applying scientific methods to solve real-world problems on large-scale data 
• Experience in managing teams of data scientists, fostering a culture of innovation, high performance, collaboration, and continuous improvement
• Hands-on experience as an individual contributor using a deep understanding of scientific methods applied to data to drive business decisions
• Demonstrated execution and impact on initiatives that cross multiple product areas and interface with leadership and product teams with a track record of influencing leaders and peers using data
• Proven track record of crafting high quality algorithmic code and identifying opportunities for efficiency and performance improvements through statistical methods
• Demonstrated execution and impact on cross-functional initiatives, strong communication skills, and a track record of influencing leaders and peers using data
• Self-propelled continuous learner who keeps up with new tools and methodologies and builds prototypes with concepts learned
• Strong business and product sense with the ability to shape ambiguous questions into well-defined analyses and success metrics that drive business decisions
• The ideal candidates will have experience with labeling platforms, measurement, and developing high quality prompts for LLMs

 

Relocation Statement:

• This position is not eligible for relocation assistance. Visit our PinFlex page to learn more about our working model.
• This role will need to be in the office for in-person collaboration 3-5 times/quarter and therefore can be situated anywhere in the country.

 

#LI-NM4

#LI-REMOTE

At Pinterest we believe the workplace should be equitable, inclusive, and inspiring for every employee. In an effort to provide greater transparency, we are sharing the base salary range for this position. The position is also eligible for equity. Final salary is based on a number of factors including location, travel, relevant prior experience, or particular skills and expertise.

Information regarding the culture at Pinterest and benefits available for this position can be found here.

US based applicants only$163,064—$335,720 USD

Our Commitment to Inclusion:

Pinterest is an equal opportunity employer and makes employment decisions on the basis of merit. We want to have the best qualified people in every job. All qualified applicants will receive consideration for employment without regard to race, color, ancestry, national origin, religion or religious creed, sex (including pregnancy, childbirth, or related medical conditions), sexual orientation, gender, gender identity, gender expression, age, marital status, status as a protected veteran, physical or mental disability, medical condition, genetic information or characteristics (or those of a family member) or any other consideration made unlawful by applicable federal, state or local laws. We also consider qualified applicants regardless of criminal histories, consistent with legal requirements. If you require a medical or religious accommodation during the job application process, please complete this form for support.