Senior Software Engineer, AI Infra Management and Ops

Microsoft • ,

2d • $119,800 - $304,200

About The Position

Help shape cloud infrastructure and artificial intelligence platforms at scale. The team builds foundational platform capabilities for large-scale distributed systems, accelerated computing environments, and next-generation cloud services. The role works across software, infrastructure, networking, and datacenter technologies to enable reliable, secure, and scalable platforms for business-critical workloads, in collaboration with engineering teams across Microsoft.

As a Senior Software Engineer, you will lead the design and evolution of cloud-native platforms, distributed systems, and infrastructure services for service lifecycle management, resource orchestration, observability, reliability, and automation. You will help guide technical strategy across engineering investments, contribute to architecture decisions involving compute, networking, storage, and platform services, and work across organizations to improve platform efficiency and developer productivity. The position offers the opportunity to deepen expertise in distributed systems and cloud infrastructure and contribute to AI infrastructure, GPU platforms, high-performance networking, and large-scale datacenter systems.

Requirements

• Bachelor's degree in Computer Science or a related technical field and 4+ years of technical engineering experience coding in languages such as C, C++, C#, Java, JavaScript, or Python, or equivalent experience.
• Ability to meet Microsoft, customer, and/or government security screening requirements, including passing the Microsoft Cloud Background Check upon hire or transfer and every two years thereafter.

Nice To Haves

• Recognized for delivering technical solutions spanning multiple engineering teams, organizations, or business areas.
• Ability to simplify complex technical challenges and translate them into practical, scalable, and maintainable solutions.
• Ability to influence technical direction through collaboration, architectural leadership, technical mentoring, and cross-organizational partnerships.
• Knowledge of large-scale distributed systems, cloud-native platforms, or infrastructure services supporting business-critical production environments.
• Familiarity with AI infrastructure, HPC environments, accelerated computing platforms, or large-scale GPU deployments.
• Knowledge of datacenter architecture, rack-scale infrastructure, network topology design, and modern datacenter networking technologies.
• Familiarity with InfiniBand fabrics, NVLink, NVSwitch, Ethernet networking, RDMA, SmartNICs, or DPUs supporting large-scale compute environments.
• Understanding of bare-metal infrastructure, hardware lifecycle management, fleet operations, infrastructure telemetry, or platform operations at scale.
• Proficiency in one or more modern programming languages such as Go, Rust, C#, Java, or Python.

Responsibilities

• Design, develop, and maintain cloud-native services and distributed systems that support platform capabilities, service lifecycle management, and operational excellence at scale.
• Collaborate across engineering organizations to help define technical direction and architecture for platform infrastructure, cloud services, networking, storage, compute, and operational excellence investments.
• Guide development of platform engineering capabilities that improve deployment automation, service lifecycle management, observability, reliability, scalability, and developer productivity.
• Advance software engineering practices, including CI/CD, IaC, testing, security, monitoring, and operational readiness throughout the engineering lifecycle.
• Contribute to the design and operation of AI infrastructure, HPC platforms, bare-metal infrastructure, GPU environments, and large-scale distributed computing systems.
• Collaborate on datacenter architecture and networking solutions, including rack-scale systems, network topology design, Ethernet and InfiniBand fabrics, RDMA, SmartNICs, DPUs, and accelerated computing platforms.
• Foster technical excellence through architecture collaboration, mentorship, knowledge sharing, design review participation, and support for engineering excellence across the broader organization.

What This Job Offers

• Job Type: Full-time
• Career Level: Senior