Principal Technical Program Manager

Microsoft•,
•$165,600 - $331,200

About The Position

The Azure HPC & AI Infrastructure team defines and delivers systems powering large AI training and inference workloads. This role provides technical leadership for networking architectures connecting GPU and accelerated-computing infrastructure, helping deliver networking capabilities for Microsoft’s AI infrastructure across technologies such as InfiniBand, RDMA, high-performance Ethernet, network interface devices, switches, optics, and emerging AI interconnect architectures. This highly cross-functional role operates across AI systems architecture, networking, GPU platforms, datacenter infrastructure, software, operations, and silicon and networking suppliers. The successful candidate defines technical strategy, shapes architecture and roadmap decisions, and drives complex infrastructure programs from early technology evaluation through qualification, deployment, and operation at hyperscale. The role calls for deep technical expertise and the ability to navigate ambiguity as technology, business requirements, and customer demand evolve. The position works with senior Microsoft engineering and product leaders and strategic technology partners to influence the performance, reliability, scalability, and economics of Microsoft’s AI infrastructure.

Requirements

  • Bachelor’s degree and 8+ years of experience in engineering, product/technical program management, data analysis, or product development, or equivalent experience.
  • 6+ years of experience managing cross-functional and/or cross-team projects.
  • Ability to meet Microsoft, customer, and/or government security screening requirements, including passing the Microsoft Cloud Background Check upon hire or transfer and every two years thereafter.

Nice To Haves

  • Bachelor’s degree and 15+ years of experience in engineering, product/technical program management, data analysis, or product development, or equivalent experience.
  • 10+ years of experience managing cross-functional and/or cross-team projects.
  • 6+ years of experience designing, developing, deploying, or operating distributed large-scale datacenter, cloud, HPC, accelerated-computing, or AI infrastructure.
  • 6+ years of deep technical experience with high-performance networking technologies such as InfiniBand, Ethernet, RDMA/RoCE, network interface devices, switches, routing and switching architectures, congestion management, optics, or high-speed interconnects.
  • 6+ years of experience evaluating complex system architectures and translating workload requirements into technical requirements, architecture decisions, and executable engineering plans.
  • 6+ years of experience influencing technical decisions without relying solely on direct organizational authority, including building alignment among engineering, architecture, operations, product, and business stakeholders.

Responsibilities

  • Define technical strategy and multi-year AI architecture direction for networking capabilities supporting Microsoft’s large-scale AI training and inference infrastructure; use fleet telemetry, performance analysis, customer signals, and operational incidents to identify systemic improvements and influence architecture and product investments.
  • Provide technical leadership across AI infrastructure systems spanning GPU and accelerated-computing infrastructure, systems software, telemetry, and operations, delivering scalable end-to-end solutions.
  • Translate AI workload requirements into system and networking architecture requirements for bandwidth, latency, topology, congestion management, resiliency, security, observability, serviceability, and operational efficiency.
  • Lead technical evaluation and architectural decision-making across InfiniBand, RDMA, advanced Ethernet fabrics, network interface devices, switches, optics, cables, GPU interconnects, and emerging AI networking technologies.
  • Drive alignment on complex architectural decisions and technical tradeoffs across networking, hardware and software engineering, systems architecture, datacenter infrastructure, operations, supply chain, finance, and customer-facing organizations.
  • Partner with internal AI workload teams and strategic customers to understand evolving training and inference requirements and translate them into infrastructure capabilities and technology roadmap investments.
  • Influence the roadmaps and technical direction of strategic silicon, networking, and systems suppliers to ensure emerging technologies meet Microsoft’s requirements for performance, reliability, scale, serviceability, supply, and cost.
  • Establish technical success criteria and engineering mechanisms for measuring performance, reliability, availability, deployment readiness, operational health, and infrastructure efficiency.
© 2026 Teal Labs, Inc
Privacy PolicyTerms of Service