AIGT Agent Operations Specialist, Model Data Operations, Platform Responsibility

Mid-level Full Time Found 13d ago

Tasks

• Adjust prompt strategies based on events
• Conduct root cause analysis of false negatives and positives
• Maintain external knowledge base
• Maintain prompt version library
• Manage Few-shot sample library
• Monitor and evaluate operational metrics
• Report daily/weekly performance
• Write and debug prompts for risk scenarios

Perks/Benefits

• N/A

Skills/Tech-stack

AI Data | AI Governance | AI data pipelines | Content Safety | Data Analysis | Data Pipelines | Debugging | Evaluation | Knowledge Base | Knowledge base management | LLM | Monitoring | Prompt Tuning | Prompt engineering | Risk detection