Quality Analyst, Prime Video Trust & Safety
Austin, Texas, USA
Amazon.com
Free shipping on millions of items. Get the best of Shopping and Entertainment with Prime. Enjoy low prices and great deals on the largest selection of everyday essentials and other products, including fashion, home, beauty, electronics, Alexa...
Our overall mission is simple: To be Earth’s most customer-centric company. We want Amazon to be the place where our customers can find, discover and buy anything online. Whatever our customers want, we will find the means to deliver it. With your help, Amazon will deliver world class AI generated experiences to our customers.
Prime Video is looking for a Quality Analyst who will have responsibility to assess the output produced by content moderators and machine learning models, assessing the quality and providing vital insights to program, operations, and science teams to improve moderator and machine learning models quality.
The role will require you to be a leader who prioritizes supporting the organization and ensuring defects do not persist. Your role will be to help set and oversee the quality standards of the data the team produces. You will define metrics, identify external signals, and build processes to reduce risk across the programs you support. You will consolidate large data sets into simplified insights that drive business growth and reduce risk.
You will also be responsible for producing reports that show the quality assessments completed by the quality team as well as conducting data analysis to identify key drivers and insights that may be reducing the effectiveness of the models’ outputs. You will produce reports and evidence backed by data and present these findings to science, engineering and program teams.
Key job responsibilities
Leadership
- Knows and communicates Amazon's mission, vision and strategy
- Interfacing with diverse stakeholders such as Program leadership, Operations leads, Technology teams, Business
- Ability to confidently facilitate team discussions and communicate business messages
- Can adapt well to changing circumstances, direction, and strategy
- Demonstrates the ability to give overall direction, performance, coordination and evaluation
- Strong interpersonal and communication skills, good listener, and comfortable interacting with up to Director level
- Ability to organize, prioritize and schedule work assignments
- Experience managing core business KPI’s
Operational Delivery
- Understands operational principles of service delivery and uses data to support continuous improvement
- Gathering requirements and delivering complete data solutions to drive insights and flag risks to Quality, Program, and Operations
- Leading complex analytical deep dives to identify potential process gaps
- Building metrics to analyze key inputs for risk detection and defect reduction
- Recognizing and adopting best practices in reporting and analysis: data integrity, test design, analysis, validation, and documentation
Continuous Improvement
- Uses data to identify areas of ongoing improvement in how content compliance and risk is managed
- Feedback Loop: Continuously communicate with the model development team to provide insights and observations regarding content moderation challenges, and potential improvements for the ML model's performance
- Data Integrity: Ensure the accuracy and integrity of the audited data by performing regular quality checks, identifying and addressing inconsistencies, and maintaining a high standard of data cleanliness
- Adaptation: Keep up-to-date with the latest content policy trends, customer expectations, language requirements, to adapt to audit strategies and guidelines accordingly
A day in the life
This is an individual contributor (IC) role focused on quality assessments and data insights for the program, operations, and quality teams to action and drive improvement.
You will provide reports that include the outcome and quality assessment of the audit and present findings, trends, and insights to business and science teams to improve the models training.
- 1+ years of tax, finance or a related analytical field experience
- 1+ years of business or financial analysis experience
- Experience with Excel
- Experience with SQL
- Experience defining requirements and using data and metrics to draw business insights
- Experience making business recommendations and influencing stakeholders
- Bachelor's degree or equivalent
- Demonstrated ability to collaborate with technical and non-technical cross-functional partners
- Ability to influence senior leaders and stakeholders
- Prior experience in a risk organization
- Prior trust & safety risk detection
- Clear and effective verbal and written communication skills
Amazon is committed to a diverse and inclusive workplace. Amazon is an equal opportunity employer and does not discriminate on the basis of race, national origin, gender, gender identity, sexual orientation, protected veteran status, disability, age, or other legally protected status.
Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have a disability and need a workplace accommodation or adjustment during the application and hiring process, including support for the interview or onboarding process, please visit https://amazon.jobs/content/en/how-we-hire/accommodations for more information. If the country/region you’re applying in isn’t listed, please contact your Recruiting Partner.
Prime Video is looking for a Quality Analyst who will have responsibility to assess the output produced by content moderators and machine learning models, assessing the quality and providing vital insights to program, operations, and science teams to improve moderator and machine learning models quality.
The role will require you to be a leader who prioritizes supporting the organization and ensuring defects do not persist. Your role will be to help set and oversee the quality standards of the data the team produces. You will define metrics, identify external signals, and build processes to reduce risk across the programs you support. You will consolidate large data sets into simplified insights that drive business growth and reduce risk.
You will also be responsible for producing reports that show the quality assessments completed by the quality team as well as conducting data analysis to identify key drivers and insights that may be reducing the effectiveness of the models’ outputs. You will produce reports and evidence backed by data and present these findings to science, engineering and program teams.
Key job responsibilities
Leadership
- Knows and communicates Amazon's mission, vision and strategy
- Interfacing with diverse stakeholders such as Program leadership, Operations leads, Technology teams, Business
- Ability to confidently facilitate team discussions and communicate business messages
- Can adapt well to changing circumstances, direction, and strategy
- Demonstrates the ability to give overall direction, performance, coordination and evaluation
- Strong interpersonal and communication skills, good listener, and comfortable interacting with up to Director level
- Ability to organize, prioritize and schedule work assignments
- Experience managing core business KPI’s
Operational Delivery
- Understands operational principles of service delivery and uses data to support continuous improvement
- Gathering requirements and delivering complete data solutions to drive insights and flag risks to Quality, Program, and Operations
- Leading complex analytical deep dives to identify potential process gaps
- Building metrics to analyze key inputs for risk detection and defect reduction
- Recognizing and adopting best practices in reporting and analysis: data integrity, test design, analysis, validation, and documentation
Continuous Improvement
- Uses data to identify areas of ongoing improvement in how content compliance and risk is managed
- Feedback Loop: Continuously communicate with the model development team to provide insights and observations regarding content moderation challenges, and potential improvements for the ML model's performance
- Data Integrity: Ensure the accuracy and integrity of the audited data by performing regular quality checks, identifying and addressing inconsistencies, and maintaining a high standard of data cleanliness
- Adaptation: Keep up-to-date with the latest content policy trends, customer expectations, language requirements, to adapt to audit strategies and guidelines accordingly
A day in the life
This is an individual contributor (IC) role focused on quality assessments and data insights for the program, operations, and quality teams to action and drive improvement.
You will provide reports that include the outcome and quality assessment of the audit and present findings, trends, and insights to business and science teams to improve the models training.
Basic Qualifications
- 1+ years of tax, finance or a related analytical field experience
- 1+ years of business or financial analysis experience
- Experience with Excel
- Experience with SQL
- Experience defining requirements and using data and metrics to draw business insights
- Experience making business recommendations and influencing stakeholders
- Bachelor's degree or equivalent
Preferred Qualifications
- 5+ years of Excel expertise (including VBA, pivot tables, array functions, power pivots, etc.) and data visualization tools such as Tableau experience- Demonstrated ability to collaborate with technical and non-technical cross-functional partners
- Ability to influence senior leaders and stakeholders
- Prior experience in a risk organization
- Prior trust & safety risk detection
- Clear and effective verbal and written communication skills
Amazon is committed to a diverse and inclusive workplace. Amazon is an equal opportunity employer and does not discriminate on the basis of race, national origin, gender, gender identity, sexual orientation, protected veteran status, disability, age, or other legally protected status.
Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have a disability and need a workplace accommodation or adjustment during the application and hiring process, including support for the interview or onboarding process, please visit https://amazon.jobs/content/en/how-we-hire/accommodations for more information. If the country/region you’re applying in isn’t listed, please contact your Recruiting Partner.
* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰
Job stats:
2
0
0
Category:
Analyst Jobs
Tags: Data analysis Data visualization Engineering Excel Finance KPIs Machine Learning ML models SQL Tableau
Perks/benefits: Career development Startup environment
Region:
North America
Country:
United States
More jobs like this
Explore more career opportunities
Find even more open roles below ordered by popularity of job title or skills/products/technologies used.
Staff Machine Learning Engineer jobsData Scientist II jobsPrincipal Data Engineer jobsStaff Data Scientist jobsBI Developer jobsData Manager jobsJunior Data Analyst jobsResearch Scientist jobsData Science Manager jobsBusiness Data Analyst jobsLead Data Analyst jobsData Engineer III jobsSenior AI Engineer jobsData Specialist jobsData Science Intern jobsSr. Data Scientist jobsPrincipal Software Engineer jobsData Analyst Intern jobsAzure Data Engineer jobsSoftware Engineer II jobsData Analyst II jobsBI Analyst jobsSoftware Engineer, Machine Learning jobsJunior Data Engineer jobsSenior Data Scientist, Performance Marketing jobs
Snowflake jobsLinux jobsEconomics jobsOpen Source jobsBanking jobsHadoop jobsJavaScript jobsComputer Vision jobsRDBMS jobsPhysics jobsKafka jobsData Warehousing jobsMLOps jobsAirflow jobsNoSQL jobsKPIs jobsR&D jobsGoogle Cloud jobsScala jobsOracle jobsData warehouse jobsStreaming jobsClassification jobsPostgreSQL jobsGitHub jobs
Scikit-learn jobsSAS jobsCX jobsTerraform jobsScrum jobsPandas jobsPySpark jobsData Mining jobsDistributed Systems jobsRobotics jobsIndustrial jobsBigQuery jobsLooker jobsJira jobsUnstructured data jobsRedshift jobsJenkins jobsE-commerce jobsdbt jobsReact jobsMicroservices jobsPharma jobsData strategy jobsMySQL jobsNumPy jobs