Senior AI Network Systems Engineer

Microsoft•Redmond, WA
•$119,800 - $261,000

About The Position

Microsoft Silicon, Cloud Hardware, and Infrastructure Engineering (SCHIE) builds and operates infrastructure and foundational technologies supporting Microsoft's online services and Azure. The Platform Systems Engineering team seeks a Senior AI Network Systems Engineer to drive the architecture, integration, validation, optimization, and deployment of large-scale AI networking infrastructure. The role emphasizes Layer 3 and Layer 4 networking, RDMA-based fabrics, TCP/UDP transport behavior, network performance, congestion management, and scale-out AI environments. The engineer will collaborate with networking, silicon, firmware, system software, validation, and Azure infrastructure teams to build reliable, high-performance AI networks for next-generation systems deployed at hyperscale. Responsibilities span AI network architecture and integration, IP networking and transport analysis, RDMA fabric design and optimization, performance characterization, end-to-end troubleshooting, and development of automation and observability solutions.

Requirements

  • Master's degree in Electrical Engineering, Computer Engineering, Mechanical Engineering, or a related field and 3+ years of technical engineering experience; or bachelor's degree in one of these fields or a related field and 5+ years of technical engineering experience; or equivalent experience.
  • 5+ years of experience developing or validating networking for accelerator-based systems.
  • 5+ years of experience designing, integrating, validating, or troubleshooting Ethernet-based networking infrastructure, including network switches.
  • 5+ years of experience supporting AI, HPC, cloud, or large-scale data center infrastructure deployments.
  • Ability to meet Microsoft, customer, and/or government security screening requirements, including passing the Microsoft Cloud Background Check upon hire or transfer and every two years thereafter.

Nice To Haves

  • Experience with RDMA technologies, AI fabrics, and distributed training environments.
  • Understanding of RoCE, congestion control, ECN, PFC, DCQCN, and related AI networking technologies.
  • Experience with AI/ML workload communication patterns and collective operations.
  • Experience with SONiC, Linux networking, networking telemetry, and network operating systems.
  • Experience with network switches, SmartNICs, DPUs, NIC offloads, and large-scale cloud infrastructure.
  • Familiarity with Ultra Ethernet and hyperscale AI cluster architectures.
  • Experience developing network stress tools, validation frameworks, performance benchmarks, or observability solutions.
  • Knowledge of packet analysis tools, telemetry infrastructure, and network automation frameworks.
  • Exposure to high-speed networking environments (200G/400G/800G Ethernet).

Responsibilities

  • Define and develop networking requirements for large-scale AI training and inference clusters.
  • Collaborate with silicon, system software, firmware, hardware, and Azure infrastructure teams to deliver scalable networking solutions from concept through datacenter deployment.
  • Participate in architecture reviews and influence next-generation AI networking roadmaps.
  • Define network concepts of operation, serviceability requirements, telemetry requirements, and operational models for AI infrastructure.
  • Lead the design and validation of IP-based AI networking solutions covering TCP/IP, UDP, routing, congestion management, flow control, QoS, and traffic engineering.
  • Analyze transport-layer behavior and performance across large-scale distributed AI workloads.
  • Evaluate network protocol implementations and debug issues affecting latency, throughput, scalability, and reliability.
  • Optimize network communication paths supporting distributed AI training and inference.
  • Design, validate, and optimize RDMA-based networking solutions for AI clusters.
  • Analyze RDMA performance, congestion behavior, packet loss, retransmissions, and collective communication efficiency.
  • Work with networking vendors and software teams to optimize AI fabric performance and workload scalability.
  • Develop validation methodologies for AI traffic patterns and collective communication workloads.
  • Develop and execute networking validation strategies covering functionality, performance, scale, interoperability, resiliency, and reliability.
  • Characterize network behavior under AI training and inference workloads, including latency, bandwidth utilization, congestion events, flow distribution, and communication patterns.
  • Create and automate network stress, scale, and performance qualification methodologies.
  • Lead end-to-end troubleshooting of networking issues across physical, data link, network, and transport layers.
  • Perform packet-level analysis and protocol debugging using telemetry, packet captures, performance counters, and diagnostic tools.
  • Investigate network switch, NIC, RDMA, routing, congestion control, and protocol-related issues.
  • Drive corrective actions and long-term reliability improvements using fleet telemetry and lab validation.
  • Build and improve network observability, diagnostics, telemetry, and monitoring solutions.
  • Develop tools and automation for network validation, performance analysis, and failure detection.
  • Improve engineering productivity through automated testing, qualification, and network health assessment frameworks.
© 2026 Teal Labs, Inc
Privacy PolicyTerms of Service