AI Validation, Senior Specialist

The Vanguard Group•Charlotte, NC

1d•Hybrid

About The Position

The Model Risk Management (MRM) Team, part of Vanguard’s second line of defense, seeks an experienced model risk professional to provide independent oversight of AI/ML and generative AI models built and/or used across the enterprise. Vanguard uses AI across its businesses and support functions to drive effectiveness, efficiency, and key business outcomes. The role leads independent validation and challenge of AI models to ensure they are conceptually sound, well-governed, and fit for purpose. It works collaboratively with data scientists, quantitative developers, model users, and technology partners while providing credible challenge. In addition to individual model reviews, the Senior Specialist helps evolve Vanguard’s model risk management framework, including methodologies, standards, and practices for consistent enterprise-wide application of model risk principles. The role also contributes to policies and procedures covering the model lifecycle and advises stakeholders on model risk policy and related standards.

Requirements

PhD in a quantitative discipline such as Computer Science, Mathematics, Statistics, Physics, or Engineering, or an equivalent combination of training and experience.
At least 7 years of relevant experience in model development or model validation.
Experience developing, testing, or validating AI/ML models or systems using generative AI.
Knowledge of programming languages, including Python.
Knowledge of technology platforms used for model development and deployment, including CI/CD.
Knowledge of generative AI architectures, including foundation models, RAG systems, agentic workflows, and prompt engineering approaches, and associated risks such as hallucinations, algorithmic bias, and harmful outputs.
Knowledge of AI/ML modeling, including ML algorithms, NLP, deep learning, and evaluation methodologies.
Exceptional written communication skills, including the ability to communicate complex model risks to technical practitioners and senior executives.
Ability to work effectively with a variety of stakeholder teams.
Ability to manage multiple and competing priorities effectively.
Flexibility and excellent judgment.

Nice To Haves

Experience in the financial services sector.
Broad knowledge of risk management at financial institutions.

Responsibilities

Assess generative AI models and systems throughout their lifecycle, including leading independent validations and assessing ongoing monitoring, change management, and remediation of model risk findings.
Challenge model assumptions, methodologies, data, testing, implementation, monitoring, and limitations, focusing on material risk drivers.
Assess compliance with internal AI standards, emerging regulatory requirements, and governance expectations for AI/ML and generative AI systems, including fairness, explainability, transparency, and human oversight.
Execute model validations on time, produce high-quality validation reports that meet internal standards, and communicate findings clearly to technical and non-technical stakeholders.
Develop, maintain, and enhance validation procedures to support consistent, risk-based independent validation and effective challenge of AI/ML and generative AI systems.
Keep informed about developments in generative and agentic AI technology.
Contribute to the design and enhancement of model risk management policies, standards, and procedures across the model lifecycle, including inventory, development, validation, approval, and ongoing monitoring.
Advise stakeholders on Model Risk policy and other relevant standards as needed.
Identify emerging and top risks across the AI/ML and generative AI model portfolio and raise them to MRM leadership.
Coach and mentor junior team members.
Participate in special projects and perform other duties as assigned.