Senior Product Manager, AI Evaluations

ServiceNow•Santa Clara, CA

9d•Hybrid

About The Position

As enterprises continue to grow their AI maturity and adoption, we need to provide our customers with tooling experiences that allow for robust evaluation of agentic AI systems and models. Agentic AI systems require the orchestration of multiple components (e.g., LLMs, RAG, frameworks), and given this level of complexity, this is a unique opportunity for someone to step in to help build a simple, but powerful experience that our allows our customers to build and deploy agentic AI systems and models with more confidence and with minimal human intervention. You will have strong customer empathy, and an innovative mindset to understand new capabilities customers need to ensure they are able to assess accuracy, performance and quality of Agentic AI systems and models. Strong partnership skills should be brought to the table to ensure that we are building products that can be used across the various business units. This role includes regular external customer engagement opportunities as part of a high-impact, customer-centric environment with a highly collaborative team.

Requirements

Experience in leveraging or critically thinking about how to integrate AI into work processes, decision-making, or problem-solving. This may include using AI-powered tools, automating workflows, analyzing AI-driven insights, or exploring AI's potential impact on the function or industry.
5+ years of Product Management experience or equivalent in a technical role in enterprise SaaS.
Experience in evaluating LLMs and AI solutions.
Experience working on developer tools and for technical end users.
Strong prioritization skills and the discipline to focus on customer needs.
Experience defining and capturing product requirements and transforming them into a product roadmap.
Deep curiosity about customer needs and a track record in building customer relationships and delivering customer-centric solutions.
Drive solution development through big-picture solution development.
Ability to inspire and align engineering teams to deliver exceptional experiences.

Responsibilities

Distill and transform ServiceNow customer and partner ideas and feedback into a cohesive product vision and roadmap.
Own end-to-end feature and capability development by defining product requirements, setting up user research, and managing development & testing by release.
Clearly communicate priorities, plans, and customer outcomes to key internal stakeholders.
Partner with ServiceNow AI research teams to plan experiments and help convert them into scalable features delivering high value for customers.
Maintain a perspective on the rapidly evolving generative AI landscape to feed product evolution around helping customers to build and deploy trustworthy Agentic AI systems.