Principal PM Manager

Microsoft • Redmond, WA

45d

About The Position

As an AI PM Manager, you will use AI evaluation as the driver of product impact. You’ll build the datasets, metrics, and experiments that define quality and steer improvements in grounding, fine-tuning, and model upgrades. Working with the latest AI technologies and frontier models, you’ll help ensure Copilot, Copilot Search, and Researcher remain at the forefront of how people use AI to get work done.
Microsoft’s mission is to empower every person and every organization on the planet to achieve more. As employees we come together with a growth mindset, innovate to empower others, and collaborate to realize our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond

Requirements

• Bachelor's Degree AND 8+ years experience in product/service/program management or software development OR equivalent experience.
• 1+ year(s) people management experience.

Nice To Haves

• Bachelor's Degree AND 12+ years experience in product/service/program management or software development OR equivalent experience.
• 3+ years people management experience.
• 4+ years experience taking a product, feature, or experience to market (e.g., design, addressing product market fit, and launch, internal tool/framework).
• 6+ years experience improving product metrics for a product, feature, or experience in a market (e.g., growing customer base, expanding customer usage, avoiding customer churn).
• Leadership experience mentoring PMs and managing cross-functional teams.
• Experience shipping commercial products, online services, or data science solutions at scale.
• Familiarity with privacy, security, and responsible product development practices.
• Proficiency in designing and maintaining evaluation datasets, test sets, and experimentation pipelines.

Responsibilities

• Shape how customers experience the latest AI advances, ensuring every prompt leads to a high-quality, trusted response.
• Collaborate closely with data scientists and engineers to design experiments, validate results, and prevent regressions.
• Lead A/B tests, prompt experiments, and model validations; define clear entry/exit criteria and ship gates.
• Design and maintain evaluation datasets, test sets, and experimentation pipelines to measure product performance reliably and repeatably.
• Monitor and analyze product metrics and evaluation signals to prioritize issues and drive timely fixes.
• Communicate results, priorities, and trade-offs clearly to leadership and cross-functional partners.
• Manage, mentor, and grow a team focused on AI quality and disciplined execution.

What This Job Offers

• Job Type: Full-time
• Career Level: Manager
• Number of Employees: 5,001-10,000 employees