Software Engineer

Microsoft

6d

About The Position

The High Performance Computing and Artificial Intelligence (HPC/AI) team is focused on building the next-generation distributed artificial intelligence supercomputer. This initiative aims to enable breakthroughs in artificial intelligence by delivering exceptional computational power, scalability, and reliability. The team designs and develops advanced infrastructure to support high-performance artificial intelligence model training at scale, laying the groundwork for innovations that expand the boundaries of what artificial intelligence can achieve.
We are looking for software engineers who are passionate about innovation and eager to design and build networking infrastructure that supports large-scale artificial intelligence training. This role centers on developing next-generation networking capabilities that ensure high performance, low latency, and minimal jitter for distributed artificial intelligence workloads. Engineers in this role will contribute to enabling cutting-edge artificial intelligence systems to reach their full potential.
As a Software Engineer on the High Performance Computing and Artificial Intelligence team, you will help shape the networking infrastructure for artificial intelligence training and inference in the Azure cloud. This opportunity places you at the intersection of two rapidly evolving fields: artificial intelligence and high-performance computing. With the growing demand for generative artificial intelligence and scalable, low-latency systems, this role offers the chance to work across diverse network architectures and emerging processor and accelerator technologies. You will help design and deliver comprehensive solutions with a focus on performance, scalability, and observability.
Microsoft’s mission is to empower every person and every organization on the planet to achieve more. As employees we come together with a growth mindset, innovate to empower others, and collaborate to realize our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond.

Requirements

• Bachelor's Degree in Computer Science, or related technical discipline OR equivalent experience
• Proven experience coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python
• Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include, but are not limited to the following specialized security screenings: Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud Background Check upon hire/transfer and every two years thereafter.

Nice To Haves

• Bachelor's Degree in Computer Science or related technical field AND 1+ year(s) technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, OR Python OR Master's Degree in Computer Science or related technical field with proven experience coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience.
• Experience with networking protocols and distributed systems
• Good understanding of protocols such as Ethernet and Transmission Control Protocol/Internet Protocol (TCP/IP).
• Experience with networking technologies in artificial intelligence-specific hardware
• Hands-on familiarity with technologies such as InfiniBand, Remote Direct Memory Access over Converged Ethernet (ROCE), and NVIDIA NVLink
• Familiarity with artificial intelligence accelerators such as Graphics Processing Units (GPUs) from NVIDIA or AMD, or Tensor Processing Units (TPUs), and their interaction with networking infrastructure
• Experience with scalable and fault-tolerant systems in large, distributed environments
• Proficiency in Linux operating systems, including kernel-level networking, performance tuning, and debugging
• Familiarity with network virtualization, software-defined networking (SDN), and telemetry and observability tools for network monitoring at scale.

Responsibilities

• Design, develop, and optimize networking solutions tailored for large-scale AI training infrastructure. Architect and implement high-performance, low-latency, and low-jitter communication frameworks for distributed systems.
• Benchmark, analyze, and enhance the scalability and reliability of networking systems to handle petabyte-scale data transfer.
• Debug and resolve complex networking issues in large-scale, high-performance environments.
• Drive identification of dependencies and the development of design documents for a product, application, service, or platform.
• Create, implement, optimize, debug, refactor, and reuse code to establish and improve performance and maintainability, effectiveness, and return on investment (ROI).
• Act as a Designated Responsible Individual (DRI) and guides other engineers by developing and following the playbook, working on call to monitor system/product/service for degradation, downtime, or interruptions, alerting stakeholders about status and initiates actions to restore system/product/service for simple and complex problems when appropriate.
• Proactively seek new knowledge and adapts to new AI trends, technical solutions, and patterns that will improve the availability, reliability, efficiency, observability, and performance of products while also driving consistency in monitoring and operations at scale.

What This Job Offers

• Job Type: Full-time
• Career Level: Entry Level