Principal Technical Program Management, AI Infrastructure

Microsoft•Redmond, WA

3d•$119,800 - $304,200

About The Position

The Principal Technical Program Manager will join Microsoft’s Cloud & AI division, within the AI Infrastructure team. The team manages the GPU fleet powering Microsoft AI services, including Microsoft AI Foundry and Copilot, and works to improve fleet efficiency, reliability, and the speed at which AI innovations move from research into production. The role focuses on platform infrastructure for demanding AI workloads, including scalable distributed computing systems and stable multi-node GPU infrastructure for inference and training. The position is accountable for the platform roadmap and for delivering infrastructure that scales AI workloads from research to production. The TPM owns a product area, develops an understanding of customer and developer needs, defines product requirements, and manages end-to-end product development, launches, and iterations. The role requires translating business goals into strategy, user experience, and technical requirements in partnership with UX, Data Science, Engineering, AI Research, and Product Marketing. It also involves defining goals and performance indicators, overseeing experiments, and evaluating success through data and research. The successful candidate will bring technical depth, customer empathy, and initiative, and will lead cross-functional teams through ambiguity and roadblocks to deliver features iteratively and quickly. The role calls for clear communication and effective collaboration across product managers, designers, engineers, and other stakeholders, with a focus on measurable outcomes and customer needs. Microsoft describes its culture as grounded in a growth mindset, innovation, collaboration, respect, integrity, accountability, and inclusion.

Requirements

Bachelor’s degree and 6+ years of experience in engineering, product or technical program management, data analysis, or product development, or equivalent experience.
3+ years of experience managing cross-functional and/or cross-team projects.
Ability to meet Microsoft, customer, and/or government security screening requirements, including passing the Microsoft Cloud Background Check upon hire or transfer and every two years thereafter.

Nice To Haves

8+ years of experience designing and shipping complex products for developers, ML professionals, or similar audiences.
3+ years of experience with a distributed platform ecosystem, such as multi-tenant systems, real-time processing, or batch computing.
Proven technical program management experience, preferably in AI infrastructure or cloud services.
Strong understanding of GPUs, virtual machines, operating systems, and cloud infrastructure fundamentals.
Excellent communication and stakeholder management skills.
Ability to navigate ambiguity and drive clarity across complex, cross-functional initiatives.
Experience creating solutions using Azure, AWS, or Google Cloud.
Experience writing Python, particularly for machine learning.
Experience with ML platforms.
Effectiveness in driving complex multi-stakeholder processes and cross-team programs.
Ability to build effective relationships, influence, and collaborate at all organizational levels.

Responsibilities

Deliver a world-class AI infrastructure stack to host AI Foundry services.
Own and manage the platform roadmap for scaling AI workloads from research to production.
Own a product area and understand developer needs and behaviors.
Define product requirements and manage end-to-end product development, launches, and iterations.
Navigate roadblocks to deliver work to customers quickly and iteratively.
Translate business goals into strategy, user experience, and technical requirements in collaboration with UX, Data Science, Engineering, AI Research, and Product Marketing.
Define goals and performance indicators, oversee experiments, and measure success using data and research.
Collaborate and communicate with cross-functional teams, including product managers, designers, and engineers, to build consumer-grade applications.
Lead and energize cross-functional teams, create clarity in ambiguous situations, and deliver features with measurable outcomes.
Embody Microsoft’s culture and values.