AI Networking

Microsoft AI • Mountain View, NY

20h • Hybrid

About The Position

Microsoft AI is hiring a Member of Technical Staff - AI Networking to design and scale high-performance networks powering Copilot and next-generation AI systems. The role focuses on end-to-end networking architecture, from link-layer systems to fabric-wide networks for hyperscale AI training clusters. The engineer will design, bring up, and scale distributed Ethernet and InfiniBand fabrics connecting large GPU clusters, and benchmark, profile, debug, and tune AI training and inference workloads in production. The work includes engineering ultra-low-latency ROCE networks, designing congestion-free transport mechanisms, and optimizing lossless fabrics at 10,000–100,000+ GPU scale, in partnership with Azure, Microsoft AI, and datacenter teams.

Microsoft AI’s mission is to build AI that amplifies human potential and empowers people worldwide. Employees are expected to work from a designated Microsoft office at least four days a week if they live within 50 miles of that office in the U.S. or 25 miles outside the U.S., subject to local law and jurisdiction-specific variation.

Requirements

• Bachelor's degree in Computer Science or a related technical field and 6+ years of technical engineering experience coding in languages such as C, C++, C#, Java, JavaScript, or Python, or equivalent experience.

Nice To Haves

• Master's degree in Computer Science or a related technical field and 8+ years of technical engineering experience coding in languages such as C, C++, C#, Java, JavaScript, or Python, or equivalent experience.
• Bachelor's degree in Computer Science or a related technical field and 12+ years of technical engineering experience coding in languages such as C, C++, C#, Java, JavaScript, or Python, or equivalent experience.

Responsibilities

• Design advanced ROCE transport and tune congestion control, ECN, WRED, and DCTCP.
• Plan fabric architecture and topology, model networks, and develop scaling strategies.
• Build telemetry and observability capabilities, improve reliability engineering, and automate troubleshooting.
• Develop and tune deployment of novel routing techniques to improve reliability in large networks.
• Collaborate with network designers, including NVIDIA, Broadcom, and internal silicon and network co-design teams.
• Bring up AI training and inference clusters, benchmark performance, and perform root-cause analysis.
• Gather data and insights to develop the pretraining compute roadmap.
• Find ways to move work forward despite roadblocks and deliver it to users quickly and iteratively.
• Work effectively in a fast-paced, design-driven product development cycle.
• Embody Microsoft’s culture and values.

Benefits

• Certain roles may be eligible for benefits and other compensation; additional information is available through Microsoft’s corporate pay and benefits page.

What This Job Offers

• Job Type: Full-time
• Career Level: Senior