Senior Manager AI Model Validation

Manulife • Boston, MA

3d • CA$129,400 - CA$179,400 • Hybrid

About The Position

This high-visibility, high-impact role supports Global AI Model Validation and Governance in identifying, assessing, and communicating risks across AI/ML models deployed globally at Manulife. The Senior Manager provides independent challenge of models, balances risks and benefits, and explains conclusions to technical and non-technical audiences.

The role works closely with model developers, business stakeholders, and risk management teams, navigating differing perspectives and aligning stakeholders. It also uses data science experience to mentor and guide junior team members. The position is based in Toronto, Ontario, with a hybrid working arrangement.

Requirements

• Master's degree or higher in Statistics, Biostatistics, Data Science, Engineering, Mathematics, or a related quantitative field.
• At least 3–5 years of combined hands-on data science experience and experience in a stakeholder-exposed role. Relevant quantitative experience may include data science, statistics, AI/ML model development or research, model validation, or model risk management.
• Strong critical-thinking skills and ability to independently challenge assumptions and assess model risk in the context of the business problem.
• Ability to write reports and implement code hands-on.
• Experience interpreting model performance metrics and conducting quantitative analyses in standard and non-standard contexts.
• Strong communication, written documentation, and stakeholder management skills.
• Ability to collaborate with people and teams across a large corporation.

Nice To Haves

• Model validation experience for AI/ML models or experience developing AI/ML models for production environments with tangible risk exposures; comparable experience may include model development in stringently risk-controlled fields such as pharmaceuticals or aerospace.
• Knowledge of AI governance and model risk regulatory expectations, particularly OSFI E-23.
• Familiarity with Responsible AI concepts, including fairness, explainability, robustness, transparency, safety, and monitoring.
• Experience evaluating Generative AI, LLMs, RAG systems, or agentic AI solutions for a broad range of business problems.
• Experience developing validation frameworks, testing libraries, or automated assurance tooling.
• Experience working in a global, cross-functional environment.
• Experience conducting AI/ML research in academic or industry settings.

Responsibilities

• Provide independent challenge and constructive feedback on AI/ML, GenAI, and agentic models by identifying weaknesses, limitations, assumptions, and risks, and recommending remediation.
• Manage competing deadlines and expectations, and coordinate procedural alignment to keep risk management activities commensurate with business risk exposure.
• Communicate technical concepts and validation findings to technical and non-technical stakeholders while ensuring the risk management process is followed.
• Review model documentation, assess model design and performance, and communicate findings through clear, evidence-based reports and recommendations.
• Conduct model testing, benchmarking, sensitivity analysis, and other validation activities.
• When appropriate, evaluate whether AI models are reliable, fair, safe, explainable, and fit for purpose.
• Support model inventory management, model risk operations, and other AI governance processes.
• Mentor and support junior data scientists through technical coaching, knowledge sharing, and review of validation approaches and methodologies.

Benefits

• Customizable health, dental, mental health, vision, short- and long-term disability, life, and AD&D insurance coverage.
• Adoption/surrogacy and wellness benefits, and employee/family assistance plans.
• Retirement savings plans, including pension and a global share ownership plan with employer matching contributions.
• Financial education and counseling resources.
• Paid time off in Canada, including holidays, vacation, personal, and sick days, and statutory leaves of absence.
• Opportunity to participate in incentive programs and earn incentive compensation tied to business and individual performance.
• Flexible environment supporting employee well-being and inclusion.

What This Job Offers

• Job Type: Full-time
• Career Level: Senior