Senior AI Analyst (AI Trust and Integrity)

Senior AI Analyst (AI Trust and Integrity)
 
Role Summary:
The Senior AI Analyst in the AI Trust and Integrity team plays a key role in ensuring the reliability, safety, and ethical compliance of AI systems.  
This role is responsible for assessing and mitigating risks, identifying and addressing vulnerabilities through rigorous testing and red teaming, and validating AI products to uphold trust, integrity and reliability. The Trust & Integrity team collaborates to develop comprehensive trust documentation, ensuring all findings, assessments, and compliance measures are clearly documented and comply with legal and regulatory standards.

Based in India, this position requires experience in AI risk assessment, vulnerability identification, and ethical compliance. Proficiency in Python is essential for testing and validating AI models, automating assessments, and supporting collaborative version control processes.  Collaborating with other analysts, legal engineers, and cross-functional teams, the Senior AI Analyst will also contribute to the continuous improvement of AI practices, staying informed on advancements in AI ethics, safety and regulatory trends. This position requires a proactive, experienced professional dedicated to driving ethical, regulatory, and security-focused AI initiatives across the organization.

Key Responsibilities:

• Monitoring and Assessment
  • Conduct continuous monitoring and risk assessments to evaluate the ethical, regulatory, and operational impacts of AI systems.
• Validation and Compliance
  • Perform validation procedures to ensure AI models meet safety, performance, and ethical standards. Conduct regular audits to verify compliance with AI policies and regulatory frameworks.
• Vulnerability Identification and Mitigation
  • Identify potential vulnerabilities within AI deployments. Provide actionable recommendations and implement measures to mitigate identified risks.
• Feedback and Improvement
  • Establish feedback mechanisms for proactive system improvements, incorporating input from stakeholders to enhance AI service quality.
• Collaboration and Cross-Functional Coordination
  • Work with operational areas to embed trust and integrity within AI applications, fostering a cohesive approach to AI development and deployment.
• Stay current on AI Ethics, Safety, and Regulatory trends
  • Share insights to help shape and refine AI practices and contribute to AI literacy within the firm. 
• Documentation and Reporting
  • Develop clear, detailed reports on system integrity, ethical compliance, and vulnerabilities for internal and external stakeholders.
• Support and Guidance
  • Provide support to junior AI analysts and guidance to other teams on AI safety and ethical standards, strengthening the team’s collective knowledge and capabilities.

Required Skills and Qualifications:

• Bachelor's degree in Computer Science, Artificial Intelligence, Ethics, or a related field.
• Experience in AI analysis, risk assessment, and validation is a must.
• Proficiency in Python for effective model testing and evaluation, particularly with large language models (LLMs).
• Strong understanding of AI ethics, safety, and regulatory compliance.
• Excellent problem-solving and analytical skills.
• Strong communication skills and the ability to present complex findings clearly.
• Proficiency in data analysis and reporting tools such as Weights and Biases.
• Detail-oriented with a proactive approach to identifying and addressing risks.
• Ability to work independently and collaboratively in a team.

Preferred Qualifications:

• Experience in a corporate or enterprise environment.
• Certification in AI or related technologies.
• Experience with red team methodologies and practices.
• Familiarity with AI auditing and compliance frameworks.

About Onit
Onit is a global leader of enterprise workflow solutions for legal, compliance, sales, IT, HR and finance departments. Our solutions transform best practices into smarter workflows, better processes and operational efficiencies. With a focus on enterprise legal management, matter management, spend management, contract management and legal holds, we operate globally and help transform the way Fortune 500 companies and billion-dollar legal departments bridge the gap between systems of record and systems of engagement. We help customers find gains in efficiency, reduce costs and automate transactions faster.