Training & Quality Specialist (Prompt Engineering), AI Data Service and Operations (ADSO) - Data Annotation Lab

Singapore, Singapore

Apply now Apply later

About Al Data Service and Operations (ADSO) Team
The Al Data Service and Operations (ADSO) team is responsible for providing safety and non-safety data annotation services and search operation services for all of the company's international products, which can also help international products build their own data ecological security.

We are seeking a Training & Quality Specialist to directly support our Prompt Engineering team, which is responsible for crafting and optimizing prompts that guide Al models toward high-quality outputs. This role is critical in maintaining the consistency, accuracy, and excellence of prompt writing through targeted quality auditing, data-driven insights, and impactful training initiatives. As a key partner to the Prompt Writers, you will be responsible for evaluating written outputs for alignment with internal guidelines, conducting root-cause analysis to identify trends or gaps, and developing responsive training materials to address areas for improvement. You will also play a vital role in onboarding new writers, driving policy comprehension, and promoting a strong quality culture across the team.

Responsibilities
• Audit Prompt Writer outputs to ensure alignment with complex policy guidelines, stylistic standards, and quality benchmarks, delivering clear feedback and actionable insights.
• Analyze performance data and error trends using both quantitative and qualitative methods to proactively identify quality gaps and implement corrective strategies.
• Partner with Prompt Writers, team leads and cross-functional teams, to maintain a consistent understanding of quality expectations and ensure calibration across teams.
• Develop, deliver, and maintain structured training programs including onboarding, policy refreshers, and upskilling modules tailored to Prompt Engineering needs.
• Regularly review and update training content and documentation to reflect evolving policies, best practices, and model capabilities.
• Support experimentation efforts by advising on quality criteria for prompt iterations and assisting with the documentation of prompting strategies and results.
• Collaborate cross-functionally with Policy, Product, and Engineering teams to address quality-related concerns and support continuous improvement initiatives.
• Maintain high documentation standards around audit records, training progress, and improvement plans to ensure traceability and accountability.
• Contribute to ad hoc quality and governance projects to elevate content integrity and team performance.
• Please note that this position involves exposure to sensitive content, including but not limited to vulgar content, violence, pornography, and fake news.
Apply now Apply later

* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰

Tags: Engineering Prompt engineering Security

Region: Asia/Pacific
Country: Singapore

More jobs like this