Principal Software Engineer

Microsoft•,

2d•$142,800 - $304,200

About The Position

Shape the future of cloud-native compute at global scale by joining as a Principal Software Engineer driving the next generation of Azure Kubernetes Service and Azure Storage platforms. You will help deliver reliable, secure, and high‑performance infrastructure that powers critical workloads for customers around the world, including modern artificial intelligence scenarios. In this role, you will lead the architecture and evolution of large-scale infrastructure spanning distributed systems, machine learning infrastructure, model serving, training platforms, observability, and platform engineering. You will partner closely with engineering and product leaders to define technical direction, set high engineering standards, and ensure operational excellence for planet-scale services. You will mentor engineers across teams, elevate engineering practices, and help translate complex technical challenges into durable, customer-centric solutions that advance our cloud platform. At Microsoft, our mission to empower every person and every organization on the planet to achieve more guides how we partner with customers to deliver trusted, impactful solutions. With a growth‑mindset culture, we innovate responsibly and measure success by shared progress, people, teams, and customers. Join us to do meaningful work that changes the world and helps shape what’s next for everyone.

Requirements

Bachelor's Degree in Computer Science or related technical field AND 6+ years technical engineering experience with coding in languages including, but not limited to, Go, C, C++, C#, Java, JavaScript, or Python OR equivalent experience.
Ability to meet Microsoft, customer and/or government security screening requirements are required for this role.
Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud Background Check upon hire/transfer and every two years thereafter.

Nice To Haves

Master's Degree in Computer Science, Computer Engineering, or a related technical field AND 8+ years of technical engineering experience developing software in Go, C, C++, C#, Java, JavaScript, or Python OR Bachelor's Degree in Computer Science, Computer Engineering, or a related technical field AND 12+ years of technical engineering experience developing software in Go, C, C++, C#, Java, JavaScript, or Python OR equivalent practical experience.
Deep experience with Kubernetes, containers, cloud platforms, networking, storage systems, site reliability engineering, and large-scale distributed systems.
Experience designing and operating machine learning platforms, large-scale model training environments, graphics processing unit infrastructure, distributed batch scheduling systems, machine learning operations frameworks, KubeRay, and Kueue.
Strong understanding of modern large language model and foundation model ecosystems, including training, inference, model serving, and observability.
Experience building and scaling enterprise artificial intelligence infrastructure and platforms that support production workloads.
Demonstrated ability to lead architecture decisions and drive technical strategy across cross-functional engineering teams.

Responsibilities

Define technical direction for cloud infrastructure and machine learning platforms across multiple engineering teams.
Design and review distributed systems that support model training, model inference, data processing, and platform services.
Work with partner teams to align architecture, reliability, security, scalability, and operational requirements.
Improve platform efficiency, including compute utilization, resource management, and service performance.
Support Machine Learning Operations (MLOps) practices for model development, deployment, monitoring, and lifecycle management.
Provide technical guidance for Kubernetes-based platforms and Artificial Intelligence (AI) workloads running in production environments.
Contribute to long-term platform planning, technical standards, and engineering best practices across the organization.