Senior Manager, AI/ML Model Validation

Work Location:

Canada

Hours:

37.5

Line of Business:

Analytics, Insights, & Artificial Intelligence

Pay Details:

We’re committed to providing fair and equitable compensation to all our colleagues. As a candidate, we encourage you to have an open dialogue with a member of our HR Team and ask compensation related questions, including pay details for this role.

Job Description:

Department Overview

The Model Validation (MV) group is a centralized Model Risk Management function within the Bank. It has seen fast growth in the past few years reflecting global regulators’ increasing attention on model risk. The Artificial Intelligence / Machine Learning (AI/ML) Model Validation team within MV is responsible for the review/vetting and approval of AI/ML models developed and used across the enterprise (e.g., Fraud, Retail Credit Risk, Marketing, NLP, TD Wealth, TD Asset Management, Treasury Balance Sheet Management, TD Insurance). By ensuring an objective and independent evaluation of models, the Model Validation function is critical to the effective measurement and management of model risk across the TD Bank Group.

Job Description

The position reports to AVP, AI/ML Model Validation group. Detailed accountabilities include:

• Lead a team of Machine Learning and Data Scientists to perform validation of all Fraud and Cyber Security models deemed in-scope by the bank-wide Model Risk Policy.

• Recommend the approval of models or other corrective actions based on the independent validation.

  • Lead and support a team of model validators.

  • Ensure performance objectives are set for all staff and that performance feedback is provided on a regular basis.

  • Communicate group objectives and strategies and align group activities in support of business objectives.

• Support employee development activities, coach and support direct reports in meeting their personal development objectives.

• Assume a leadership role in developing standards and procedures for vetting and validation Fraud and Cyber Security models that are compliant with the Bank’s internal Model Risk Policy, adhere with industry and academic best practices, and meet regulatory requirements.

• Respond to requests from both Canadian and U.S. regulators, internal and external audit in their review/audit of models and vetting/validation process and procedures. Provide information and assistance as required.

• Work effectively with internal Model Development groups, Audit, and other internal partners to ensure models meet required Bank standards for use.

• Play a key role in ensuring the appropriate use of Fraud and Cyber Security models. Identify the need to implement new models/techniques as industry standards evolve and regulatory requirements change.

• Maintain full professional knowledge of techniques and developments in the field of AI and Machine Learning, and share knowledge with business partners and senior management. Provide subject matter expertise to business units on AI/ML Fraud and Cyber Security modeling and validation.

Job Requirements

• Advanced quantitative and AI / ML skills with post-secondary degree in one or more of the following areas: Machine Learning, AI, finance, engineering, software engineering, statistics, economics / econometrics, mathematics

• 4+ years of experience in either developing or validating Fraud / Cyber Security models; and 2+ years of experience in leading a small team of data scientists.

• In-depth knowledge of fraud risk management and detection of different types of fraud attacks.

• In-depth knowledge of AI / Machine Learning techniques, concepts and theory; Statistical/probability theory and applications. Understanding of weaknesses and limitation of popular ML modeling approaches.

• Deep knowledge of popular tabular ML algorithms such as XGBoost/LightGBM, Random Forest, and etc.

• In-depth knowledge of AI/ML Explainability/Interpretability concepts, tools and techniques

• Ability to research and implement Machine Learning algorithms from academic research papers is a plus.

• Proficient in relevant programming languages such as Python, PySpark, SQL. Experience with Microsoft Azure cloud infrastructure, Databricks is an asset.

• Object Oriented Programming, GIT, MLOps / Dev.Ops; Experience maintaining an ML library is a plus.

• Excellent verbal and written communication skills; and stakeholder management abilities (position requires writing and reviewing reports of technical nature).

• Strong critical and analytic thinking skills.

• Excellent time / project management and multitasking skills with minimal supervision.

• Stay up to date with the latest advancements in fraud risk management, data science, machine learning, and AI.

Who We Are:

TD is one of the world's leading global financial institutions and is the fifth largest bank in North America by branches/stores. Every day, we deliver legendary customer experiences to over 27 million households and businesses in Canada, the United States and around the world. More than 95,000 TD colleagues bring their skills, talent, and creativity to the Bank, those we serve, and the economies we support. We are guided by our vision to Be the Better Bank and our purpose to enrich the lives of our customers, communities and colleagues.

TD is deeply committed to being a leader in customer experience, that is why we believe that all colleagues, no matter where they work, are customer facing. As we build our business and deliver on our strategy, we are innovating to enhance the customer experience and build capabilities to shape the future of banking. Whether you’ve got years of banking experience or are just starting your career in financial services, we can help you realize your potential. Through regular leadership and development conversations to mentorship and training programs, we’re here to support you towards your goals. As an organization, we keep growing – and so will you.

Our Total Rewards Package
Our Total Rewards package reflects the investments we make in our colleagues to help them and their families achieve their financial, physical, and mental well-being goals. Total Rewards at TD includes a base salary, variable compensation, and several other key plans such as health and well-being benefits, savings and retirement programs, paid time off, banking benefits and discounts, career development, and reward and recognition programs. Learn more

Additional Information:
We’re delighted that you’re considering building a career with TD. Through regular development conversations, training programs, and a competitive benefits plan, we’re committed to providing the support our colleagues need to thrive both at work and at home.

Colleague Development
If you’re interested in a specific career path or are looking to build certain skills, we want to help you succeed. You’ll have regular career, development, and performance conversations with your manager, as well as access to an online learning platform and a variety of mentoring programs to help you unlock future opportunities. Whether you have a passion for helping customers and want to expand your experience, or you want to coach and inspire your colleagues, there are many different career paths within our organization at TD – and we’re committed to helping you identify opportunities that support your goals.
 

Training & Onboarding
We will provide training and onboarding sessions to ensure that you’ve got everything you need to succeed in your new role.

Interview Process 
We’ll reach out to candidates of interest to schedule an interview. We do our best to communicate outcomes to all applicants by email or phone call.

Accommodation
Your accessibility is important to us. Please let us know if you’d like accommodations (including accessible meeting rooms, captioning for virtual interviews, etc.) to help us remove barriers so that you can participate throughout the interview process.

We look forward to hearing from you!

Language Requirement:

Maîtrise d’une langue autre que le français pour offrir du soutien ou traiter avec des employés ou des collègues qui ont besoin de services et de soutien dans une langue autre que le français./This position requires proficiency in a language other than French to support or deal with employees who require services and support in a language other than French.