Generative AI Monitoring Analyst, Compliance & Control, S&P Global Ratings

S&P Global•Boulder, CO

40d•$116,000 - $143,000•Hybrid

About The Position

The role of the Generative AI Monitoring Analyst is to design and execute a monitoring program focused on the performance and utilization of Generative AI tools within S&P Global Ratings. They are members of the Risk & Compliance Department, which serves as a critical control function for S&P Global Ratings. This position supports the mitigation of risks and enhancement of controls for the ongoing quality of S&P's ratings, research, and other products as the organization expands its use of Generative AI tools. In particular, the Analyst will participate in risk-based activities, including reviewing large data sets and developing tests and tools to detect unusual or problematic performance or usage. They will then collaborate with other control team members to investigate the findings. The role is situated within a global team that values collaboration, and requires excellent multi-tasking skills, attention to detail, strong verbal and written communication abilities, and the capacity to analyze and solve problems in a timely and insightful manner. It will suit a diligent and analytically curious self-starter with a strong work ethic and a drive to succeed.

Requirements

3+ years of relevant experience in financial services.
Knowledge of risk management and framework development to conduct compliance monitoring reviews.
Knowledge of automation techniques.
Knowledge of AI and machine learning.
Understanding of financial markets, the business environment, and financial data.
Proficiency with Excel, SQL, and Python required.
Experience in data mining, data warehousing, and data mapping.
BA or BS in a business or financial engineering field.

Nice To Haves

MBA
Proficiency with VBA and R

Responsibilities

Assesses the effectiveness of controls over the operation of Generative AI tools and models and reviews structured and unstructured data from internal and external sources used in Generative AI tools and models.
Demonstrates an understanding of AI tools and risks, gaining a comprehensive working knowledge of S&P's relevant tools, and assists in the generation and preparation of metrics and reporting on AI-generated data input/output.
Evaluates the performance of Generative AI tools to ensure they are functioning as expected and that their uses remain as intended through the development of risk-based monitoring reviews.
Assesses the adequacy and effectiveness of governance of AI tools from development to operation and subsequent revisions.
Coordinates with global offices to ensure data analyses and reports are accessible to all relevant stakeholders and are treated consistently.
Assists with planning, organizing, executing, and documenting all activities. Conducts ad-hoc research as necessary.
Conducts regular reviews and audits to ensure compliance with established standards.
Applies knowledge of Excel or other programming languages, such as Python or R, to contribute to the oversight of the development and application of tools that utilize AI to facilitate analyses, visualizations, and develop risk-based monitoring reviews.

Benefits

Health & Wellness: Health care coverage designed for the mind and body.
Flexible Downtime: Generous time off helps keep you energized for your time on.
Continuous Learning: Access a wealth of resources to grow your career and learn valuable new skills.
Invest in Your Future: Secure your financial future through competitive pay, retirement planning, a continuing education program with a company-matched student loan contribution, and financial wellness programs.
Family Friendly Perks: It's not just about you. S&P Global has perks for your partners and little ones, too, with some best-in class benefits for families.
Beyond the Basics: From retail discounts to referral incentive awards-small perks can make a big difference.

Stand Out From the Crowd

Upload your resume and get instant feedback on how well it matches this job.

Upload and Match Resume