Manager, Model Quality

Requisition ID:

Join a purpose driven winning team, committed to results, in an inclusive and high-performing culture.

The world is changing faster than ever and so are we

"Big data", "AI" and "machine learning" are not just buzzwords; they are part of our daily life. We have decades of data powering hundreds of models deployed across a multitude of systems that are crying out for smart talented team players who are results-oriented, have a broad understanding of best-in-class processes and relish the opportunity to help us turn our vision into reality. Are you ready to join the Winning Team not only building but actively managing the high-performing prediction and forecasting models behind automated risk-management decisions and forecasts that impact millions of customers and keep hundreds of $billions safe every single day?

Model Quality is all about ensuring that everything we build, we build right the first time, and we build them to last. The right candidate for this role is NOT someone who wants to design and build a handful of models each year but rather, is someone willing to take on the challenge of understanding how hundreds of them (spanning a wide range of problem types, employing a myriad of methodologies) work and can, commensurately, design and execute testing plans, and build capabilities to stress, test, and validate those models during pre and post implementation, and ongoing production runs.

This role will be a key member of Scotiabank's Retail & Small Business Model Operations team responsible for ensuring that every part of the model lifecycle from development to implementation, deployment to management, and tracking to governance unfolds as effectively & efficiently as possible. In Model Operations, we are passionate about arming our stakeholders with the best data & tools possible so that they can build and run the best models possible. We obsess over getting things done quickly and done right, the first time. We leverage a combination of business / technical consulting, collaborative development and verification / testing in our approaches.We get excited by automation. We love working with people; both internally with our peers (across business strategy, risk & technology) and externally with vendors alike. We make modelling easier and models easier to use. Getting models to market quickly is important but getting them "right" is even more so. That is where you come in. In this role, you will lead the testing of data changes, models, and crucial reporting impacting not just our partners but the bank's quarterly financial filings both with investors and with the regulator. You will collaborate on a regular basis with a wide range of stakeholders and internal partners including Model Owners (model developers), Technology & Data, and Project Teams.

Is this role right for you? In this role, you will:

• You believe, first and foremost, in always doing the right thing and doing things the right way

• You have demonstrated aptitude to design scenario-specific Test Approaches, Test Strategies & Plans, align test cases to requirements and user stories and select the appropriate test tools

• You understand data engineering and modeling concepts to strategize and execute End to End testing cycles (Including data extraction, transformations and conversion)

• You can evaluate test results, derive model and business insights, synthesize results and communicate high-quality recommendations effectively, both verbally, and in writing

• You enable performance measurement by using standard metrics and drive continuous improvements
• You ensure ongoing compliance with quality and industry regulatory requirements
• Prepare quality documentation and reports by collecting, analyzing, and summarizing information and trends including failed processes, stability studies, corrective actions, and re-validations
• You are willing and able to suggest and make framework enhancements to accommodate scripting needs for automation
• You are curious, pragmatic, and a critical thinker
• You have strong interpersonal skills and are able to interface and effectively influence at all organizational levels
• You are professional, motivated AND FUN. We mean it.

Do you have the skills that will enable you to succeed in this role? - We'd love to work with you if you have:

General

• Bachelor's degree in engineering, Computer Science, Business Administration or an equivalent field
• A demonstrated history of analytic problem solving and sound judgment
• Experience as an analyst or data scientist with a track record of accomplishments working on cross-functional teams
• Experience in, and strong understanding of testing standards and methodology, in QAT / UAT / BAT environments
• Understands and utilizes both quality assurance and quality control best practices and how to apply them to models, data and technology from both a static and dynamic perspective

Technical

• Highly proficient in 1 or more analytical programming languages (Python, R, SAS, etc.), SQL (Teradata, Oracle, DB2, SQL Server) and multiple environments (Unix & Windows)
• Strong fundamental understanding of mathematical models, forecasting and statistics
• Knowledge about credit risk models / scorecards
• Microsoft Office (Word, Excel, etc.) power user with demonstrated experience writing professional acceptance reports, memos, and presentations
• Familiar with both traditional SDLC and agile development processes & tools (Jira, Confluence)
• Working Knowledge of Test Management Tools (Micro Focus ALM, Zephyr, Test Rail)
• Experience with continuous Integration tools - Jenkins, Bit bucket, GitHub

Location(s): Canada : Ontario : Toronto

Scotiabank is a leading bank in the Americas. Guided by our purpose: "for every future", we help our customers, their families and their communities achieve success through a broad range of advice, products and services, including personal and commercial banking, wealth management and private banking, corporate and investment banking, and capital markets.

At Scotiabank, we value the unique skills and experiences each individual brings to the Bank, and are committed to creating and maintaining an inclusive and accessible environment for everyone. If you require accommodation (including, but not limited to, an accessible interview site, alternate format documents, ASL Interpreter, or Assistive Technology) during the recruitment and selection process, please let our Recruitment team know. Candidates must apply directly online to be considered for this role. We thank all applicants for their interest in a career at Scotiabank; however, only those candidates who are selected for an interview will be contacted.