Principal Product Manager - M365 Copilot LLM Platform

Microsoft • Redmond, WA

13h • $142,800 - $304,200 • Hybrid

About The Position

Microsoft’s M365 Core Copilot Infrastructure team is hiring a Principal Product Manager to own and architect the M365 LLM platform that powers Copilot across Microsoft 365. This is a technical product leadership role focused on the platform end to end, including hardware selection, GPU and CPU fleet management and allocation, model serving, and optimization. The role turns platform strategy into products, roadmaps, and decisions, and builds intelligent self-service systems to replace manual, ticket-driven processes.

The position leads AI-driven decision systems that use agents, automation, telemetry, availability, demand, and operational constraints to improve platform outcomes. The product manager will translate technical and financial tradeoffs into actionable direction for leaders and promote AI-forward workflows, including evaluation sets and agent-based processes. The role partners with engineering leaders, architects, data scientists, finance, supply chain, Copilot scenario teams, and platform partners. It calls for independent leadership, sound judgment in ambiguous situations, and mentoring and developing other product managers.

The position is based in Redmond, Washington, and requires working in the office at least three days per week. Microsoft describes its mission as empowering every person and organization to achieve more, and emphasizes growth mindset, innovation, collaboration, respect, integrity, accountability, and inclusion.

Requirements

• Bachelor's degree and 8+ years of experience in product, service, or program management or software development, or equivalent experience.
• Experience as a product owner or architect for large-scale cloud, AI, or distributed systems platforms, with the ability to reason end to end from hardware to service.
• Experience with LLMs, model-serving platforms, GPU infrastructure, or large-scale AI-powered products.
• Experience building AI-driven or automated products that replace manual operational processes.
• Experience independently driving ambiguous, high-stakes work from strategy through execution across organizations.
• Ability to think at the platform level while maintaining a strong customer mindset and translating customer and partner needs into durable platform capabilities.
• Experience leading large-scale cloud infrastructure, capacity planning, or distributed systems work, with an understanding of hyperscale service delivery.
• AI fluency, including using AI agents, automation, and prototyping to accelerate analysis, decisions, and product work.
• Experience using telemetry, demand signals, and operational data to guide platform and investment decisions.
• Systems-level problem-solving and clear communication, including the ability to influence senior leaders and align stakeholders across organizations.
• Ability to work in the Redmond office at least three days per week.

Nice To Haves

• Bachelor's degree and 12+ years of experience in product, service, or program management or software development, or equivalent experience.
• 4+ years of experience taking a product, feature, or experience to market, including design, product-market fit, and launch.
• 6+ years of experience improving product metrics, such as growing a customer base, expanding usage, or avoiding churn.
• 6+ years of experience disrupting a market for a product, feature, or experience.
• Experience mentoring and developing product managers and technical leaders.

Responsibilities

• Own the product vision, strategy, and roadmap for the infrastructure layer of the M365 LLM platform, translating direction into executable plans for engineering teams.
• Act as a platform architect across hardware SKU selection, fleet management and allocation, model serving, and optimization, driving consistent decisions across these areas.
• Lead product direction for AI-driven decision systems, including agents and automation that recommend GPU and CPU placement, allocation, and transitions based on live constraints, availability, and demand.
• Replace manual, ticket-driven intake and allocation with intelligent self-service platform capabilities, and measure adoption and impact.
• Partner with Copilot scenario teams and platform partners to understand their needs and translate them into durable platform capabilities and investments.
• Identify and prioritize efficiency and performance optimizations across hardware, serving, and models, balancing cost, performance, and reliability with engineering, finance, and supply chain partners.
• Advance platform, model, and hardware transition strategy, including onboarding new hardware generations and models.
• Use AI agents, automation, and AI-driven analysis to examine telemetry, model tradeoffs, prototype solutions, and accelerate decisions.
• Mentor and develop product managers and technical leaders, and help raise the bar for how the team works.

Benefits

• The posting notes that certain roles may be eligible for benefits and other compensation, and links to Microsoft benefits and pay information; specific benefits are not listed.

What This Job Offers

• Job Type: Full-time
• Career Level: Principal