Legal Prompt Generation and Annotation Specialist (English)

Join the CrowdGen team as an Independent Contractor for Project Aristotle Legal. We are seeking a Legal expert to develop complex, skill-based prompts and evaluate AI responses for legal accuracy and logical soundness. This role emphasizes creating challenging legal problems that test advanced AI models, ensuring they require nuanced legal reasoning and the application of multiple areas of law.
Key Responsibilities:- Legal-Focused Prompt Generation: Develop intricate legal scenarios or problems that combine multiple areas of law (e.g., contract law and torts) to challenge advanced AI models like GPT-40.- AI Response Evaluation: Review AI-generated legal analyses, identifying errors in legal reasoning, statutory interpretation, or case law application.- Skill Integration: Ensure each prompt integrates multiple legal concepts, requiring the AI to apply them in complex and non-trivial ways.- Model Refinement: Provide detailed feedback on the AI’s performance, contributing to its improvement in addressing complex legal questions and producing accurate legal analyses.
Qualifications:- Native-level fluency in English.- Strong background in Law, ideally with a law degree (JD, LLB, or equivalent) and legal practice experience.- Experience creating or analyzing complex legal issues across multiple fields (e.g., constitutional law, corporate law, intellectual property).- Ability to spot and explain errors in legal reasoning, interpretation, or case law application.- Familiarity with AI/ML models and their limitations is a plus.
This is a project-based role with CrowdGen, where you will join the community as an Independent Contractor. Upon selection, you will receive an email with instructions to create an account, reset your password, and complete the onboarding process.
This role is ideal for someone with deep legal expertise who is passionate about contributing to the advancement of AI systems in understanding and applying legal principles.