Senior Technical Program Manager, HPC
About The Position
At Microsoft AI, we build the frontier models and products that reach millions of people, from pretraining through post-training, evaluation, and launch. The infrastructure behind this work operates at massive scale, and its reliability, availability, and operational readiness are critical to keeping researchers and engineers productive. We are looking for a Technical Program Manager, HPC to drive the operational health and reliability of the high-performance computing infrastructure supporting Microsoft AI. You will partner closely with HPC engineering, platform, networking, storage, capacity, datacenter, and Azure teams to ensure production clusters are healthy, available, and ready to support demanding AI workloads. This role sits at the intersection of HPC infrastructure, production operations, reliability, and technical program management. You will establish the operating mechanisms that identify problems early, coordinate rapid recovery when incidents occur, drive systemic fixes, and ensure service commitments are consistently met. You will need enough technical depth to engage credibly on cluster health, compute, networking, storage, schedulers and infrastructure dependencies, combined with the program leadership needed to coordinate complex issues across organizational boundaries.
Requirements
- Significant experience in technical program management, infrastructure engineering, production operations, site reliability, or large-scale distributed systems.
- Demonstrated experience delivering complex, cross-functional programs spanning multiple engineering organizations.
- Technical fluency in large-scale infrastructure, including areas such as HPC, compute, accelerators, networking, storage, schedulers, capacity, telemetry, or distributed systems.
- Experience driving production incident management, including escalation, mitigation, root-cause analysis, and corrective actions.
- Experience working with SLAs, SLOs, availability metrics, and production-health indicators.
- Ability to use operational data and incident trends to identify systemic problems and drive reliability improvements.
- Strong ability to build relationships and influence engineering teams across organizational boundaries.
- Excellent written and verbal communication skills, with the ability to translate complex technical issues into clear risks, decisions, and actions.
Nice To Haves
- Experience supporting GPU or accelerator-based HPC/AI infrastructure at scale.
- Experience with cloud infrastructure spanning compute, networking, storage, capacity, or datacenter operations.
- Experience establishing reliability programs, operational scorecards, health dashboards, or incident-management mechanisms for large infrastructure environments.
Responsibilities
- Own end-to-end programs for HPC production health and operational readiness, driving cluster availability, reliability, and service performance.
- Establish operating mechanisms for cluster health, including SLA/SLO reviews, NIS/RIS tracking, incident trends, risks, dependencies, and corrective actions.
- Drive critical incident management, coordinating triage, escalation, mitigation, stakeholder communication, root-cause analysis, and follow-through across HPC and Azure teams.
- Identify systemic reliability issues using operational signals and incident patterns, and partner with engineering teams to drive durable improvements.
- Build strong cross-functional partnerships across Azure compute, networking, storage, capacity, datacenter, and platform teams to resolve dependencies and establish effective escalation paths.
- Define and track operational metrics and dashboards that provide actionable visibility into cluster health, availability, incidents, risks, and SLA/SLO performance.
- Proactively manage production risks and dependencies, surfacing issues to engineering and leadership before they become critical blockers.
- Drive alignment without formal authority, connecting engineering and service owners around shared reliability goals and accountable execution.
- Communicate production health, major incidents, risks, and trade-offs to leadership with clear ownership and action plans.
Benefits
- The typical base pay range for this role across the U.S. is USD $142,800 - $274,800 per year.
- There is a different range applicable to specific work locations, within the San Francisco Bay area and New York City metropolitan area, and the base pay range for this role in those locations is USD $188,000 - $304,200 per year.
- Certain roles may be eligible for benefits and other compensation.
- Find additional benefits and pay information here: https://careers.microsoft.com/us/en/us-corporate-pay
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
What This Job Offers
Job Type
Full-time
Career Level
Senior
Education Level
No Education Listed
