Senior Technical Program Manager, AI Infrastructure

Microsoft • Redmond, WA

1d • $119,800 - $304,200

About The Position

The Senior Technical Program Manager will join Microsoft’s Cloud & AI division on the AI Infrastructure team, which manages the GPU fleet powering Microsoft AI Foundry, Copilot, and other AI services. The team focuses on fleet efficiency, reliability, scalable distributed computing, stable multi-node GPU infrastructure, and bringing AI innovations from research into production for training and inference workloads.

The role owns a product area and its platform roadmap, helping scale AI workloads from research to production. The TPM will understand developer needs and customer problems, define product requirements, and lead end-to-end product development, launches, and iterations. Working across Engineering, Research, Go To Market, UX, Data Science, and Product Marketing, the role translates business goals into strategy, user experience, and technical requirements, and uses goals, performance indicators, experiments, data, and research to evaluate outcomes. Success requires creating clarity amid ambiguity, energizing cross-functional teams, and delivering features iteratively with measurable results.

The position requires a Microsoft Cloud Background Check upon hire or transfer and every two years thereafter. The posting lists base pay ranges for Technical Program Management IC4 and IC5, with different ranges for the San Francisco Bay Area and New York City metropolitan area. The role is open for at least five days, with applications accepted until filled.

Requirements

• Bachelor’s degree and at least 4 years of experience in engineering, product or technical program management, data analysis, or product development, or equivalent experience.
• At least 2 years of experience managing cross-functional and/or cross-team projects.
• Ability to meet Microsoft, customer, and/or government security screening requirements, including passing the Microsoft Cloud Background Check upon hire or transfer and every two years thereafter.

Nice To Haves

• At least 8 years of experience designing and shipping complex products for developers, ML professionals, or similar audiences.
• At least 3 years of experience with distributed platform ecosystems, such as multi-tenant systems, real-time processing, or batch computing.
• Proven technical program management experience, preferably in AI infrastructure or cloud services.
• Strong understanding of GPUs, virtual machines, operating systems, and cloud infrastructure fundamentals.
• Excellent communication and stakeholder management skills.
• Ability to navigate ambiguity and drive clarity across complex, cross-functional initiatives.
• Experience creating solutions using Azure, AWS, or Google Cloud.
• Experience writing Python, particularly for machine learning.
• Experience with ML platforms.
• Effectiveness in driving complex multi-stakeholder processes and cross-team programs.
• Ability to build effective relationships, influence, and collaborate at all organizational levels.

Responsibilities

• Deliver an AI infrastructure stack to host AI Foundry services.
• Own the platform roadmap for scaling AI workloads from research to production.
• Own a product area and understand developer needs and behaviors.
• Define product requirements and manage end-to-end product development, launches, and iterations.
• Find ways to overcome roadblocks and deliver work to customers quickly and iteratively.
• Translate business goals into strategy, user experience, and technical requirements in collaboration with UX, Data Science, Engineering, AI Research, and Product Marketing.
• Define goals and performance indicators, oversee experiments, and measure success using data and research.
• Collaborate and communicate with cross-functional teams, including product managers, designers, and engineers.
• Embody Microsoft’s culture and values.

What This Job Offers

• Job Type: Full-time
• Career Level: Senior