Principal Software Engineer, AI Infra Management and Ops

Microsoft•,
•$119,800 - $304,200

About The Position

Microsoft is hiring a Principal Software Engineer to help shape cloud infrastructure and artificial intelligence platforms at scale. The role works across software, infrastructure, networking, and datacenter technologies to build reliable, secure, and scalable platforms for business-critical workloads. The engineer will lead the design and evolution of cloud-native platforms, distributed systems, and infrastructure services supporting service lifecycle management, resource orchestration, observability, reliability, and automation. The position contributes to technical strategy and architecture across compute, networking, storage, and platform services, and collaborates across Microsoft organizations to improve platform efficiency and developer productivity. The work includes AI infrastructure, GPU platforms, high-performance networking, and large-scale datacenter systems.

Requirements

  • Bachelor's degree in Computer Science or a related technical field and 6+ years of technical engineering experience coding in languages such as C, C++, C#, Java, JavaScript, or Python, or equivalent experience.
  • Ability to meet Microsoft, customer, and/or government security screening requirements, including passing the Microsoft Cloud Background Check upon hire or transfer and every two years thereafter.

Nice To Haves

  • Recognition for delivering technical solutions spanning multiple engineering teams, organizations, or business areas.
  • Ability to simplify complex technical challenges and translate them into practical, scalable, and maintainable solutions.
  • Ability to influence technical direction through collaboration, architectural leadership, technical mentoring, and cross-organizational partnerships.
  • Knowledge of large-scale distributed systems, cloud-native platforms, or infrastructure services supporting business-critical production environments.
  • Familiarity with AI infrastructure, HPC environments, accelerated computing platforms, or large-scale GPU deployments.
  • Knowledge of datacenter architecture, rack-scale infrastructure, network topology design, and modern datacenter networking technologies.
  • Familiarity with InfiniBand fabrics, NVLink, NVSwitch, Ethernet networking, RDMA, SmartNICs, or DPUs in large-scale compute environments.
  • Understanding of bare-metal infrastructure, hardware lifecycle management, fleet operations, infrastructure telemetry, or platform operations at scale.
  • Proficiency in one or more modern programming languages such as Go, Rust, C#, Java, or Python.

Responsibilities

  • Lead the design, development, and evolution of cloud-native services, distributed systems, and platform capabilities for large-scale production environments.
  • Collaborate across engineering organizations to define technical direction and architecture for platform infrastructure, cloud services, networking, storage, compute, and operational excellence investments.
  • Guide development of platform engineering capabilities that improve deployment automation, service lifecycle management, observability, reliability, scalability, and developer productivity.
  • Advance software engineering practices, including CI/CD, IaC, testing, security, monitoring, and operational readiness throughout the engineering lifecycle.
  • Contribute to the design and operation of AI infrastructure, HPC platforms, bare-metal infrastructure, GPU environments, and large-scale distributed computing systems.
  • Collaborate on datacenter architecture and networking solutions, including rack-scale systems, network topology design, Ethernet and InfiniBand fabrics, RDMA, SmartNICs, DPUs, and accelerated computing platforms.
  • Promote technical excellence through architecture collaboration, mentorship, knowledge sharing, design reviews, and support for engineering excellence across the organization.
© 2026 Teal Labs, Inc
Privacy PolicyTerms of Service