Principal AI Systems Architect

Microsoft•Redmond, WA
•$165,600 - $331,200

About The Position

Microsoft is seeking a Principal AI Systems Architect to join the Systems Pathfinding and Architecture (SPARC) team within its Azure Hardware Systems and Infrastructure organization. The team develops the core infrastructure and foundational technologies behind Microsoft’s cloud businesses. In this broad role, you will define system architecture requirements and make a direct impact on Microsoft AI accelerator systems. You will shape AI rack- and cluster-scale architecture, assess tradeoffs across performance and total cost of ownership, develop proof-of-concepts, own product requirements and specifications, and align engineering and leadership teams. The role also includes using simulations and hardware models to assess architecture options and participating in industry consortiums to influence standards and vendor roadmaps.

Requirements

  • Master’s degree in Electrical Engineering, Computer Engineering, Mechanical Engineering, or a related field and 9+ years of technical engineering experience; or a bachelor’s degree in one of these fields and 11+ years of technical engineering experience; or equivalent experience.
  • Ability to meet Microsoft, customer, and/or government security screening requirements, including passing the Microsoft Cloud Background Check upon hire or transfer and every two years thereafter.

Nice To Haves

  • Doctorate in Electrical Engineering, Computer Engineering, Mechanical Engineering, or a related field and 8+ years of technical engineering experience; or a master’s degree in one of these fields and 12+ years of technical engineering experience; or a bachelor’s degree in one of these fields and 15+ years of technical engineering experience; or equivalent experience.
  • Experience in large-scale AI datacenter systems and their networks.
  • Demonstrated expertise in one or more domains: networking (RoCE, InfiniBand transports, congestion control, or network topology design), reliability and serviceability, or datacenter architecture for large-scale AI systems.
  • Experience owning hardware system architecture at scale across machine, rack row, and cluster, including authoring specifications and requirements.
  • Ability to make decision tradeoffs across domains.
  • Deep expertise in AI systems or a key domain such as networking, reliability, or power management.
  • Skill in partnering with and influencing architects, hardware engineers, and software leads.
  • Ability to manage ambiguity, bring clarity, establish direction, and drive decisions.
  • Collaboration skills, teamwork, and a sense of presumed responsibility.

Responsibilities

  • Define AI rack- and cluster-scale architecture across accelerators, hosts, networks, memory, storage, power, cooling, and datacenter constraints, making quantitative tradeoffs across performance and total cost of ownership.
  • Develop functional proof-of-concepts to evaluate and de-risk new capabilities.
  • Write and own high-level product requirements and specifications.
  • Drive alignment across cross-functional engineering and leadership teams and own outcomes.
  • Use performance simulations and hardware models for what-if studies to evaluate and select architecture options.
  • Participate in industry consortiums to shape standards and influence vendor roadmaps.

Benefits

  • Certain roles may be eligible for benefits and other compensation; additional benefits and pay information is available through Microsoft Careers.
© 2026 Teal Labs, Inc
Privacy PolicyTerms of Service