Principal Product Manager

Microsoft • Redmond, WA

1d

About The Position

Microsoft is seeking a Principal Product Manager to set the technical and product direction for the Copilot Offline Evaluation Platform, a key part of Microsoft’s broader Copilot Evaluation ecosystem. The platform assesses the quality and reliability of Copilot experiences before production by enabling teams to run controlled evaluations with synthetic or curated datasets across non-production tenants. These evaluations simulate real-world scenarios to validate feature performance, detect regressions, and establish quality baselines.

The role owns the end-to-end technical and product strategy of the offline evaluation platform, including how evaluation datasets are generated and curated, realistic test environments are built, evaluations run at scale, and results inform ship decisions. This is an individual-contributor leadership role, leading through technical and product expertise, clear thinking, hands-on work in the systems, and mentoring PMs and engineers.

Requirements

• Bachelor's degree and 10+ years of experience in product/service/program management or software development, or equivalent experience.
• Ability to meet Microsoft, customer, and/or government security screening requirements, including passing the Microsoft Cloud Background Check upon hire or transfer and every two years thereafter.
• Experience leading product design and technical strategy for software or service products.
• Experience shipping large-scale enterprise software or cloud services, including platform architecture used by many internal or external teams.
• Hands-on experience with AI/ML evaluation, including metric design, model-based judging, dataset curation and synthetic data, offline and online experimentation, and responsible AI practices.
• Experience with test and data infrastructure at scale, such as test environments, data pipelines, telemetry, and results analytics.
• Ability to lead through influence across organizational boundaries, build trusted relationships with partner teams, and clarify shared goals and dependencies.
• Ability to innovate at the platform level and carry integrated, end-to-end solutions through to shipping.
• Solid problem-solving skills and drive for results.
• Self-starter who identifies problems early, proposes solutions, and gets the right teams moving on them.
• Experience mentoring PMs and engineers and growing technical leaders.

Nice To Haves

• Bachelor's degree and 15+ years of experience in product/service/program management or software development, or equivalent experience.
• 6+ years of experience taking a product, feature, or experience to market, such as through design, product-market fit, and launch, including internal tools or frameworks.
• 8+ years of experience improving product metrics for a product, feature, or experience in a market, such as growing customer base, expanding customer usage, or avoiding customer churn.
• 8+ years of experience disrupting a market for a product, feature, or experience, such as through competitive disruption or replacing an established competing product.

Responsibilities

• Define the strategic roadmap for platform initiatives and align it with business and product goals.
• Collaborate with stakeholders to identify and prioritize key platform features and enhancements.
• Define project scopes, goals, and deliverables, and communicate them effectively to team members and stakeholders.
• Drive execution of multiple complex projects simultaneously while ensuring quality standards and timelines are met.
• Work with engineering, data science, and product teams to define technical requirements and align platform capabilities with business needs.
• Serve as a point of contact for internal stakeholders, address concerns, provide regular updates, and manage expectations.
• Demonstrate deep technical knowledge of the platform, algorithms, and infrastructure needed for the product.
• Lead through influence and hands-on work, and mentor PMs and engineers.

What This Job Offers

• Job Type: Full-time
• Career Level: Principal