AI Model Monitoring Lead

Work Location:

Toronto, Ontario, Canada

Hours:

37.5

Line of Business:

Analytics, Insights, & Artificial Intelligence

Pay Details:

$125,500 - $154,000 CADThe pay details posted reflect a temporary market premium specific to this role that is reassessed annually.

TD is committed to providing fair and equitable compensation opportunities to all colleagues. Growth opportunities and skill development are defining features of the colleague experience at TD. Our compensation policies and practices have been designed to allow colleagues to progress through the salary range over time as they progress in their role. The base pay actually offered may vary based upon the candidate's skills and experience, job-related knowledge, geographic location, and other specific business and organizational needs.

As a candidate, you are encouraged to ask compensation related questions and have an open dialogue with your recruiter who can provide you more specific details for this role.

Job Description:

Department Overview

What does TD stand for? For starters, we believe in visionary leadership and insights. We believe in using every resource at our disposal to better serve our clients, and for almost every department, that begins with data.

As part of Layer 6's Strategy and Operations team, you'll be at the heart of driving AI to for our teams, customers, and colleagues. TD's vision for the future? Hyper-personalized banking experiences via artificial intelligence for every single customer. If you've been in business as long as we have, you know there's no such thing as one size fits all, and a diverse, inclusive Layer 6 team is a massive part of that future achievement.

Job Description

1. Engage and collaborate with TD's artificial intelligence (AI), machine learning (ML) and Infrastructure teams to define / improve / mature the general monitoring and reporting solutions and processes for Layer 6 AI models, and to develop new monitoring approaches

2. Maintain model monitoring guidelines and standard templates for model monitoring plans

3. Work with AI Delivery teams and Partners to define and standardize model-specific monitoring requirements, and to document and transition the monitoring plans and capabilities post-model delivery

4. Regularly meet with Governance and Risk Control Partners to ensure that there is alignment on monitoring processes, requirements and activities and that open governance items/requirements are being fulfilled

5. Maintain inventory of Layer 6-monitored AI models & related open governance items, and work with partners to fulfill all ongoing governance requirements

6. Build a cross model cross-model view on monitoring requirements and best practices, and establish new agreed upon monitoring metrics to help manage and mature our monitoring practice

7. Ensure accuracy and timeliness of model monitoring results, and package them into reports for the Model Owner and other stakeholders

8. Analyze the monitoring results for anomalies, developing trends, threshold breaches, and escalate appropriately to Model Owners and stakeholders, and work with team to understand the root causes and to remediate

9. Support Audit or other oversight processes for the individual monitored models

Qualifications

• Minimum three years of experience delivering major data science projects

• Master's degree+ in a related discipline, or equivalent experience
• Expert coding proficiency: python, R, SQL and Scala, cloud architecture

• Expert technical skills: machine learning, data engineering, MLOps, cloud solution architecture, software development practices

• Communication, documentation prep, business acumen and stakeholder management competencies

• Minimum 2 years leading and performing model monitoring activities

• A very organized self-starter who is attentive to detail and a proactive planner
• Experience with operationalizing or enhancing model monitoring processes (an asset)

• Experience navigating large and complex matrix structured organization

Who We Are:

TD is one of the world's leading global financial institutions and is the fifth largest bank in North America by branches/stores. Every day, we deliver legendary customer experiences to over 27 million households and businesses in Canada, the United States and around the world. More than 95,000 TD colleagues bring their skills, talent, and creativity to the Bank, those we serve, and the economies we support. We are guided by our vision to Be the Better Bank and our purpose to enrich the lives of our customers, communities and colleagues.

TD is deeply committed to being a leader in customer experience, that is why we believe that all colleagues, no matter where they work, are customer facing. As we build our business and deliver on our strategy, we are innovating to enhance the customer experience and build capabilities to shape the future of banking. Whether you've got years of banking experience or are just starting your career in financial services, we can help you realize your potential. Through regular leadership and development conversations to mentorship and training programs, we're here to support you towards your goals. As an organization, we keep growing – and so will you.

Our Total Rewards Package

Our Total Rewards package reflects the investments we make in our colleagues to help them and their families achieve their financial, physical, and mental well-being goals. Total Rewards at TD includes a base salary, variable compensation, and several other key plans such as health and well-being benefits, savings and retirement programs, paid time off, banking benefits and discounts, career development, and reward and recognition programs. Learn more

Additional Information:

We're delighted that you're considering building a career with TD. Through regular development conversations, training programs, and a competitive benefits plan, we're committed to providing the support our colleagues need to thrive both at work and at home.

Please be advised that this job opportunity is subject to provincial regulation for employment purposes. It is imperative to acknowledge that each province or territory within the jurisdiction of Canada may have its own set of regulations, requirements.

Colleague Development

If you're interested in a specific career path or are looking to build certain skills, we want to help you succeed. You'll have regular career, development, and performance conversations with your manager, as well as access to an online learning platform and a variety of mentoring programs to help you unlock future opportunities. Whether you have a passion for helping customers and want to expand your experience, or you want to coach and inspire your colleagues, there are many different career paths within our organization at TD – and we're committed to helping you identify opportunities that support your goals.

Training & Onboarding

We will provide training and onboarding sessions to ensure that you've got everything you need to succeed in your new role.

Interview Process

We'll reach out to candidates of interest to schedule an interview. We do our best to communicate outcomes to all applicants by email or phone call.

Accommodation

Your accessibility is important to us. Please let us know if you'd like accommodations (including accessible meeting rooms, captioning for virtual interviews, etc.) to help us remove barriers so that you can participate throughout the interview process.

We look forward to hearing from you

Language Requirement (Quebec only):

Sans Objet