Principal AI Back-End Network Systems Lead

Microsoft•Redmond, WA
•$142,800 - $304,200

About The Position

Microsoft Silicon, Cloud Hardware, and Infrastructure Engineering (SCHIE) powers Microsoft's expanding cloud infrastructure and supports Microsoft Azure and other online services worldwide. The Platform Systems Engineering team seeks a technical lead and end-to-end product development owner for Back End Network across scale-up and scale-out. This role owns the product from requirements and architecture through design, integration, validation, manufacturing readiness, deployment, and fleet learning, encompassing silicon, network adapters, switches, interconnects, optics and electrical channels, and the fabric as a complete system. The successful candidate brings deep expertise in one or more AI/ML scale-up or scale-out networking domains and product-level judgment across the full system. The role connects physical and data-link technologies with network and transport behavior, collectives, workloads, modeling, observability, and datacenter deployment. It creates clarity across architecture, execution, quality, performance, reliability, power, cost, and schedule.

Requirements

  • Master's degree in Electrical Engineering, Computer Engineering, Mechanical Engineering, or a related field and 7+ years of technical engineering experience; or bachelor's degree in one of those fields and 8+ years of technical engineering experience; or equivalent experience.
  • Ability to meet Microsoft, customer, and/or government security screening requirements, including passing the Microsoft Cloud Background Check upon hire or transfer and every two years thereafter.

Nice To Haves

  • Bachelor's degree in Electrical Engineering, Computer Engineering, Computer Science, or a related technical field and 10+ years of relevant experience in networking, distributed systems, accelerator platforms, or cloud infrastructure, or equivalent experience.
  • 6+ years of experience designing, developing, integrating, or validating networking for AI/ML, HPC, accelerator, or large-scale cloud systems.
  • Deep hands-on expertise in at least one AI/ML networking domain, such as scale-up interconnects and silicon/SerDes/PHY, electrical or optical connectivity, switch systems, scale-out Ethernet/RDMA fabrics, transport/congestion control, collective communication, or workload/fabric performance.
  • Demonstrated experience leading a complex hardware/software product or subsystem through requirements, architecture, development, integration, validation, and production deployment.
  • Experience architecting or delivering both scale-up and scale-out networks for large AI training or inference systems.
  • Experience with high-speed electrical and optical technologies, SerDes/PHY, FEC, signal integrity, link training, retimers, cable/backplane design, pluggable or co-packaged optics, and 400G/800G or faster links.
  • Experience with switch ASICs and systems, NICs/DPUs, Ethernet, RDMA/RoCE, routing, QoS, ECN/PFC/DCQCN or related congestion-control methods, SONiC/Linux networking, and network operating systems.
  • Understanding of collective communication libraries and operations, distributed training parallelism, AI workload traffic patterns, and workload-driven network optimization.
  • Experience with network and system modeling, simulation, emulation, performance analysis, topology studies, traffic generation, or collective/workload scaling analysis.
  • Experience developing automated validation, stress, reliability, interoperability, telemetry, diagnostics, observability, and fleet-health frameworks.
  • Track record of system bring-up and cross-layer debugging from physical links through protocol, runtime, collectives, and application behavior.
  • Experience driving manufacturing readiness, supplier/partner execution, datacenter deployment, serviceability, and fleet operations for hardware-intensive products.
  • Strong product judgment, technical leadership, collaboration, written communication, and executive presentation skills.

Responsibilities

  • Own Back End Network product definition and execution across scale-up and scale-out, from customer and workload needs through requirements, architecture, development, qualification, deployment, and fleet learning.
  • Translate AI training and inference requirements into measurable system targets for bandwidth, latency, scale, collective efficiency, reliability, availability, serviceability, power, thermal behavior, cost, security, and schedule.
  • Drive cross-system architecture decisions, interface contracts, feature priorities, risk tradeoffs, ownership, milestones, entry and exit criteria, and product-readiness metrics.
  • Lead assessments, prototypes, make/buy/partner decisions, and mitigation plans for new, unique, different, and difficult technologies and product risks.
  • Lead architecture and integration across accelerator and networking silicon, NICs/DPUs, PHYs/retimers, switch ASICs, switches, cables/backplanes, optics, and fabric topology.
  • Define scalable scale-up and scale-out architectures, including topology, radix, reach, link speeds, routing, path diversity, oversubscription, failure domains, and resiliency.
  • Drive silicon, board, switch, firmware, network operating system, and fabric requirements so components operate as one high-performance, serviceable product.
  • Partner with silicon, switch, optical, cable, connector, system, manufacturing, and supplier teams to deliver designs from concept through production and datacenter integration.
  • Oversee electrical and optical high-speed-link technologies and tradeoffs involving signal integrity, SerDes/PHY, link training, FEC, reach, power, thermal, mechanical design, manufacturability, and interoperability.
  • Drive end-to-end behavior across physical, data-link, network, and transport layers and the system/runtime interfaces above them.
  • Define and validate Ethernet/RDMA or other scale-up/scale-out protocol behavior, including flow control, congestion control, QoS, routing, packet loss and recovery, telemetry, and security.
  • Align hardware, firmware, drivers, network operating systems, management software, orchestration, and datacenter operations to common specifications and concepts of operation.
  • Connect network architecture to distributed AI workloads, parallelism strategies, traffic patterns, and collective operations such as all-reduce, all-gather, reduce-scatter, and all-to-all.
  • Establish analytical and simulation models for topology, bandwidth, latency, congestion, failure behavior, collective efficiency, workload scaling, power, and cost.
  • Use models, emulation, prototypes, and lab/fleet data to predict bottlenecks, guide design choices, set performance budgets, and validate architectural assumptions.
  • Partner with workload, collective-communication, compiler/runtime, and application teams to co-optimize the network, job completion time, and cluster efficiency.
  • Own end-to-end validation for functionality, interoperability, performance, scale, stress, resiliency, reliability, security, serviceability, and upgrade/recovery behavior.
  • Lead bring-up and root-cause analysis across silicon, electrical/optical links, switches, fabric, protocols, system software, collectives, and workload layers using telemetry, packet captures, counters, diagnostics, and lab characterization.
  • Define production qualification, manufacturing test, deployment, monitoring, rollback, and fleet-health requirements, and use operational learning to drive corrective actions and future improvements.
  • Drive product-readiness reviews and ensure the solution can be safely and repeatably deployed, operated, serviced, and scaled in hyperscale datacenters.
  • Create technical clarity and alignment across architecture, silicon, hardware, optics, firmware, networking, software, validation, manufacturing, datacenter, and workload teams.
  • Influence internal roadmaps and external partners and ecosystems, including silicon, switch, optical, interconnect, ODM/OEM, and open-source partners; resolve cross-team gaps and ambiguous ownership.
  • Communicate product status, architectural decisions, risks, tradeoffs, and executive asks; mentor engineers and improve end-to-end systems engineering quality.

Benefits

  • The posting states that certain roles may be eligible for benefits and other compensation and directs candidates to Microsoft's corporate pay information; specific benefits are not listed.
© 2026 Teal Labs, Inc
Privacy PolicyTerms of Service