Senior Software Engineer
About The Position
The HPC/AI (High-Performance Computing and Artificial Intelligence) team builds the networking and systems infrastructure that powers Azure's largest AI supercomputing clusters. We develop scalable distributed systems, communication libraries, and network technologies that enable efficient training and deployment of next-generation AI models across thousands of accelerators. We're seeking Senior Software Engineers to solve challenging problems in backend network architecture, RDMA communication libraries, network transport protocols, and large-scale distributed systems. You'll work on technologies that deliver ultra-low latency, high throughput, and predictable performance for distributed AI workloads, where communication efficiency directly impacts model training and inference performance. In this role, you'll design and build next-generation networking solutions spanning transport protocols, collective communication frameworks, observability systems, and performance optimization technologies. You'll develop RDMA-based communication libraries and networking software that operate at the scale of modern AI supercomputers, enabling efficient communication across large GPU and accelerator clusters. You'll collaborate closely with engineers across networking, hardware, silicon, AI frameworks, and datacenter infrastructure to deliver end-to-end solutions. Your work will involve performance analysis, scalability optimization, fault tolerance, telemetry, and the development of innovative networking technologies that advance the state of large-scale distributed AI systems. Generative AI and distributed computing are driving unprecedented demand for scalable infrastructure. As a Senior Software Engineer on our team, you'll help shape the networking backbone behind Azure's AI supercomputing platform, influencing how future generations of AI systems are built, trained, and deployed at global scale. Microsoft’s mission is to empower every person and every organization on the planet to achieve more. As employees we come together with a growth mindset, innovate to empower others and collaborate to realize our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond.
Requirements
- Bachelor's Degree in Computer Science or related technical field AND 4+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience.
- Ability to meet Microsoft, customer and/or government security screening requirements are required for this role.
- These requirements include, but are not limited to the following specialized security screenings: Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud Background Check upon hire/transfer and every two years thereafter.
Nice To Haves
- Master's Degree in Computer Science or related technical field AND 6+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR Bachelor's Degree in Computer Science or related technical field AND 8+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience.
- 5+ years of experience in software design, development, and performance optimization of distributed systems, large-scale infrastructure, networking software, or communication libraries.
- 3+ years of experience with high-performance networking technologies and architectures, including RDMA, Ethernet or InfiniBand fabrics, transport protocols, or communication libraries.
- 1+ years of experience with hardware-software co-design involving networking, accelerators, GPUs, DPUs, NICs, or large-scale system architectures.
- 1+ years of experience with performance analysis, profiling, benchmarking, and optimization of distributed or HPC workloads.
Responsibilities
- Design, develop, and optimize networking solutions for large-scale AI training and inference infrastructure, with a focus on performance, scalability, and reliability.
- Lead the design and implementation of network transport protocols, RDMA-based communication libraries, and distributed systems technologies that power AI supercomputing clusters.
- Analyze and optimize end-to-end communication performance, including latency, throughput, congestion management, collective communication efficiency, and workload scalability.
- Investigate and resolve complex networking and distributed systems challenges across production-scale AI infrastructure.
- Drive technical architecture, author design specifications, identify dependencies, and influence engineering decisions across multiple teams and technology areas.
- Collaborate across networking, hardware, silicon, AI framework, and infrastructure teams to deliver end-to-end solutions that improve the performance, reliability, and observability of large-scale AI systems.
Benefits
- Certain roles may be eligible for benefits and other compensation. Find additional benefits and pay information here: https://careers.microsoft.com/us/en/us-corporate-pay
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
What This Job Offers
Job Type
Full-time
Career Level
Senior
