TikTok Shop - Large Language Model Quality Analyst

About the team
Global E-Commerce's Governance and Experience (GNE) is a global team responsible for ensuring a safe and trustworthy marketplace for not only our buyers, but also our sellers and creators. The Service and Moderation Team (SMT) is part of the GNE organization. Our mission is to create the most trustworthy E-commerce platform with a delightful service experience. SMT is looking for a Model Labeling Quality Assurance Analyst role to manage BPO partners to make high quality delivery for model labeling projects to assure model accuracy.

Roles & Responsibilities
- Continuously improve the large model's moderation accuracy through quality inspection, analyzing abnormal data, accurately attributing issues, and raising alerts.
- Conduct CoT (Chain-of-Thought) fine labeling for typical tasks to optimize large model training data and improve model inference ability.
- Attribute quality issues, accurately identify problems at each stage, categorize them, and escalate to relevant teams for resolution.
- Analyze the effectiveness of moderation rules and determine whether issues stem from the rules themselves, suggesting improvements as needed.
- Participate in the creation and optimization of quality inspection processes. Identify process or attribution label system issues during attribution and drive continuous improvements.
- Collaborate closely with large model operations, policy, model labeling, and other teams to optimize moderation policies, model decisions, and engineering capabilities.
- Provide structured feedback and support to help external stakeholders resolve issues.