Training & Quality Specialist (Prompt Engineering), AI Data Service and Operations (ADSO) - Data Annotation Lab
Singapore, Singapore
⚠️ We'll shut down after Aug 1st - try foo🦍 for all jobs in tech ⚠️
About Al Data Service and Operations (ADSO) Team
The Al Data Service and Operations (ADSO) team is responsible for providing safety and non-safety data annotation services and search operation services for all of the company's international products, which can also help international products build their own data ecological security.
We are seeking a Training & Quality Specialist to directly support our Prompt Engineering team, which is responsible for crafting and optimizing prompts that guide Al models toward high-quality outputs. This role is critical in maintaining the consistency, accuracy, and excellence of prompt writing through targeted quality auditing, data-driven insights, and impactful training initiatives. As a key partner to the Prompt Writers, you will be responsible for evaluating written outputs for alignment with internal guidelines, conducting root-cause analysis to identify trends or gaps, and developing responsive training materials to address areas for improvement. You will also play a vital role in onboarding new writers, driving policy comprehension, and promoting a strong quality culture across the team.
Responsibilities
• Audit Prompt Writer outputs to ensure alignment with complex policy guidelines, stylistic standards, and quality benchmarks, delivering clear feedback and actionable insights.
• Analyze performance data and error trends using both quantitative and qualitative methods to proactively identify quality gaps and implement corrective strategies.
• Partner with Prompt Writers, team leads and cross-functional teams, to maintain a consistent understanding of quality expectations and ensure calibration across teams.
• Develop, deliver, and maintain structured training programs including onboarding, policy refreshers, and upskilling modules tailored to Prompt Engineering needs.
• Regularly review and update training content and documentation to reflect evolving policies, best practices, and model capabilities.
• Support experimentation efforts by advising on quality criteria for prompt iterations and assisting with the documentation of prompting strategies and results.
• Collaborate cross-functionally with Policy, Product, and Engineering teams to address quality-related concerns and support continuous improvement initiatives.
• Maintain high documentation standards around audit records, training progress, and improvement plans to ensure traceability and accountability.
• Contribute to ad hoc quality and governance projects to elevate content integrity and team performance.
• Please note that this position involves exposure to sensitive content, including but not limited to vulgar content, violence, pornography, and fake news.
The Al Data Service and Operations (ADSO) team is responsible for providing safety and non-safety data annotation services and search operation services for all of the company's international products, which can also help international products build their own data ecological security.
We are seeking a Training & Quality Specialist to directly support our Prompt Engineering team, which is responsible for crafting and optimizing prompts that guide Al models toward high-quality outputs. This role is critical in maintaining the consistency, accuracy, and excellence of prompt writing through targeted quality auditing, data-driven insights, and impactful training initiatives. As a key partner to the Prompt Writers, you will be responsible for evaluating written outputs for alignment with internal guidelines, conducting root-cause analysis to identify trends or gaps, and developing responsive training materials to address areas for improvement. You will also play a vital role in onboarding new writers, driving policy comprehension, and promoting a strong quality culture across the team.
Responsibilities
• Audit Prompt Writer outputs to ensure alignment with complex policy guidelines, stylistic standards, and quality benchmarks, delivering clear feedback and actionable insights.
• Analyze performance data and error trends using both quantitative and qualitative methods to proactively identify quality gaps and implement corrective strategies.
• Partner with Prompt Writers, team leads and cross-functional teams, to maintain a consistent understanding of quality expectations and ensure calibration across teams.
• Develop, deliver, and maintain structured training programs including onboarding, policy refreshers, and upskilling modules tailored to Prompt Engineering needs.
• Regularly review and update training content and documentation to reflect evolving policies, best practices, and model capabilities.
• Support experimentation efforts by advising on quality criteria for prompt iterations and assisting with the documentation of prompting strategies and results.
• Collaborate cross-functionally with Policy, Product, and Engineering teams to address quality-related concerns and support continuous improvement initiatives.
• Maintain high documentation standards around audit records, training progress, and improvement plans to ensure traceability and accountability.
• Contribute to ad hoc quality and governance projects to elevate content integrity and team performance.
• Please note that this position involves exposure to sensitive content, including but not limited to vulgar content, violence, pornography, and fake news.
* Salary range is an estimate based on our AI, ML, Data Science Salary Index 💰
Job stats:
9
0
0
Tags: Engineering Prompt engineering Security
Region:
Asia/Pacific
Country:
Singapore
More jobs like this
Explore more career opportunities
Find even more open roles below ordered by popularity of job title or skills/products/technologies used.
Sr. Data Engineer jobsPrincipal Data Engineer jobsBusiness Intelligence Developer jobsPower BI Developer jobsData Scientist II jobsStaff Data Scientist jobsPrincipal Software Engineer jobsStaff Machine Learning Engineer jobsDevOps Engineer jobsData Science Intern jobsJunior Data Analyst jobsAI/ML Engineer jobsSoftware Engineer II jobsStaff Software Engineer jobsData Science Manager jobsData Manager jobsLead Data Analyst jobsData Analyst Intern jobsData Specialist jobsSr. Data Scientist jobsBusiness Data Analyst jobsData Governance Analyst jobsBusiness Intelligence Analyst jobsData Engineer III jobsSenior Backend Engineer jobs
Business Intelligence jobsAirflow jobsMLOps jobsOpen Source jobsKafka jobsEconomics jobsKPIs jobsGitHub jobsLinux jobsJavaScript jobsTerraform jobsRAG jobsPostgreSQL jobsBanking jobsPrompt engineering jobsStreaming jobsScikit-learn jobsData Warehousing jobsNoSQL jobsRDBMS jobsClassification jobsComputer Vision jobsPhysics jobsdbt jobsPandas jobs
Google Cloud jobsScala jobsHadoop jobsLangChain jobsGPT jobsData warehouse jobsMicroservices jobsR&D jobsBigQuery jobsCX jobsDistributed Systems jobsELT jobsReact jobsScrum jobsOracle jobsLooker jobsIndustrial jobsPySpark jobsOpenAI jobsJira jobsRobotics jobsRedshift jobsSAS jobsUnstructured data jobsTypeScript jobs