AI Protection Analyst

Minimum qualifications:

• Bachelor's degree or equivalent practical experience.
• 2 years of experience in data analysis, including identifying trends, generating summary statistics, and drawing insights from quantitative and qualitative data.
• 2 years of experience managing projects and defining project scope, goals, and deliverables.

Preferred qualifications:

• Master's Degree in Computer Science.
• 4 years of relevant work experience in a large-scale data analysis.
• 2 years of experience with machine learning systems.
• Experience in at least one programming language (e.g., Go, Python, R, Julia, C/C++, Java, SQL).
• Experience in security threat or abuse detection, analysis and investigation.
• Excellent written and verbal communication skills.

About the job

Trust & Safety team members are tasked with identifying and taking on the biggest problems that challenge the safety and integrity of our products. They use technical know-how, excellent problem-solving skills, user insights, and proactive communication to protect users and our partners from abuse across Google products like Search, Maps, Gmail, and Google Ads. On this team, you're a big-picture thinker and strategic team-player with a passion for doing what’s right. You work globally and cross-functionally with Google engineers and product managers to identify and fight abuse and fraud cases at Google speed - with urgency. And you take pride in knowing that every day you are working hard to promote trust in Google and ensuring the highest levels of user safety.

Trust and Safety Cloud AI Protection (CAIP)’s mission is to enable the rapid growth of Google Cloud Platform (GCP) and Workspace AI businesses by curbing associated safety and security risks.CAIP supports GCP and Workspace AI products throughout their life-cycle by advancing safety protection mechanisms in the earliest stages of product design. Specifically, CAIP’s service portfolio includes both pre and post launch capabilities.

As an AI Protection analyst, you will have the opportunity to shape the safety of Google AI products. You will ensure that our AI products are not only powerful but also safe, secure, and aligned with our AI principles and every AI product is as resilient as it can be by designing and building an industry leading AI agent system to protect Google AI from misuse. You will help to solve challenging problems in AI safety and misuse at Google scale.At Google we work hard to earn our users’ trust every day. Trust & Safety is Google’s team of abuse fighting and user trust experts working daily to make the internet a safer place. We partner with teams across Google to deliver bold solutions in abuse areas such as malware, spam and account hijacking. A team of Analysts, Policy Specialists, Engineers, and Program Managers, we work to reduce risk and fight abuse across all of Google’s products, protecting our users, advertisers, and publishers across the globe in over 40 languages.

Responsibilities

• Identify and investigate possible failure modes for GenAI products on a broad range from sociotechnical harms to misuse.
• Design and build implementation for anti-abuse detection and action systems, including detection and enforcement AI agents, to protect Google Cloud and Workspace AI products at scale.
• Perform in-depth analysis of risks, measure and mitigate AI-related risks, using benchmarking, evaluations, dataset design, and usage monitoring.
• Prepare analysis reports and present findings and solutions to stakeholders with exceptional written and verbal communication.
• Collaborate with other Google teams to ensure that the issues are understood and solutions are adopted.