LLM Training Operation (Safety) - Analyst

Responsibilities

About ByteDance
Founded in 2012, ByteDance's mission is to inspire creativity and enrich life. With a suite of more than a dozen products, including TikTok, Helo, and Resso, as well as platforms specific to the China market, including Toutiao, Douyin, and Xigua, ByteDance has made it easier and more fun for people to connect with, consume, and create content.

Why Join Us
Creation is the core of ByteDance's purpose. Our products are built to help imaginations thrive. This is doubly true of the teams that make our innovations possible. Together, we inspire creativity and enrich life - a mission we aim towards achieving every day. To us, every challenge, no matter how ambiguous, is an opportunity; to learn, to innovate, and to grow as one team. Status quo? Never. Courage? Always. At ByteDance, we create together and grow together. That's how we drive impact - for ourselves, our company, and the users we serve. Join us.

About the team
As a core member of our LLM Global Data Team, you'll be at the heart of our operations. Gain first-hand experience in understanding the intricacies of training Large Language Models (LLMs) with diverse data sets. Through our carefully designed rotation program, you'll witness how high-quality data is meticulously crafted and used. After completing your rotation, you will have the chance to select your area of expertise. This will be your stepping stone to lead, train, or oversee larger data operation projects.

Your Role Will Involve:
1. Lead multiple data labeling projects simultaneously, ensuring cross-functional alignment to establish advanced data standards and optimized workflows. This involves assembling specialized taskforces, coordinating milestones, and driving agile progress management. Additionally, assess requirement feasibility, design tailored project management strategies and SOPs, and support continuous operational improvements to effectively meet diverse needs.
2. Gain hands-on experience in data production, including drafting, revising, and data acceptance evaluation, while developing specialized skills across different data formats and content verticals to independently deliver high-quality data. This provides insight into the synergy between human input and data in LLM training.
3. Collaborate with product managers and engineers to assess, enhance, and experiment with operational processes, focusing on quality and productivity improvements. Interprete and translate safety stance and advisories into operational requirements. Perform routine data analysis on model performance, anticipate project risks, address urgent issues, and implement effective risk control measures.
4. It is possible that this role will be exposed to harmful content as part of the core role/as part of project/ in response to escalation requests/by chance. This may occur in the form of images, video, and text related to every-day life, but it can also include (but is not limited to) bullying; hate speech; child safety; depictions of harm to self and others, and harm to animals.

Qualifications

Minimum Qualifications:
1. Excellent English writing and critique skills.
2. Comfortable working in a project-based fast-paced environment, where quality standards iterate quickly with research and experiment progress.
3. Comfortable with meeting deadlines, multi-tasking, and generating creative solutions, including the use of technology and tools, to enhance the quality of both individual and team outputs.
4. A minimum of 3 years of experience in project management within content-related projects or operations, with a strong preference for backgrounds in journalism, teaching, writing, or text editing. Experience in leading AI/LLM companies or within the Trust and Safety industry is highly valued.

Preferred Qualifications:
1. Candidates should be intelligent, diligent, and skilled in providing guidelines, analyzing cases and structuring complex operational improvements.
2. A deep interest in LLMs, human behavior and user experience is essential. The ideal candidate is an enthusiastic learner who finds engagement with diverse case studies and annotators stimulating.

Note: This role requires a paper test prior to interviews.

ByteDance is committed to creating an inclusive space where employees are valued for their skills, experiences, and unique perspectives. Our platform connects people from across the globe and so does our workplace. At ByteDance, our mission is to inspire creativity and enrich life. To achieve that goal, we are committed to celebrating our diverse voices and to creating an environment that reflects the many communities we reach. We are passionate about this and hope you are too.