Senior Software Engineer - AI Infrastructure

Microsoft • Redmond, WA

8d • $119,800 - $261,000

About The Position

As a Senior Software Engineer in Microsoft’s Artificial Intelligence Infrastructure organization, you will design, build, and operate scalable platform services that help teams across Microsoft onboard, deploy, monitor, govern, and manage AI workloads throughout their lifecycle. The role focuses on foundational technologies for deploying, managing, and operating large-scale AI models and services, working across cloud infrastructure, developer experience, reliability engineering, and AI innovation.

You will collaborate with engineers, product leaders, researchers, and platform teams to deliver resilient cloud services, improve operational excellence, and accelerate adoption of AI infrastructure capabilities. The opportunity includes developing expertise in distributed systems, cloud infrastructure, reliability engineering, and Machine Learning Operations platforms, while driving architecture and influencing engineering strategy across organizations.

Requirements

• Bachelor's degree in Computer Science or a related technical field and 4+ years of technical engineering experience coding in languages such as C, C++, C#, Java, JavaScript, or Python, or equivalent experience.
• Experience designing, building, and operating large-scale distributed systems or cloud services with high availability, reliability, and performance requirements.
• Experience with Microsoft Azure, Kubernetes, containers, infrastructure as code, and modern continuous integration and continuous deployment (CI/CD) systems.
• Experience operating production services, including observability, incident management, capacity planning, and service health monitoring.
• Experience building developer platforms, control planes, orchestration systems, workflow engines, or platform services used by other engineering teams.

Nice To Haves

• Master's degree in Computer Science or a related technical field and 6+ years of technical engineering experience coding in languages such as C, C++, C#, Java, JavaScript, or Python; or a bachelor's degree in Computer Science or a related technical field and 8+ years of such experience; or equivalent experience.

Responsibilities

• Design, build, and operate large-scale distributed systems that power the lifecycle of AI models and services across Microsoft.
• Drive the architecture, implementation, and evolution of cloud platform capabilities that improve deployment velocity, reliability, governance, and operational excellence for AI workloads.
• Partner with engineering, product management, and research teams to translate complex business and technical requirements into scalable platform solutions.
• Lead development of highly available, secure, and observable services using Site Reliability Engineering (SRE) principles and practices.
• Improve developer productivity by creating self-service experiences, automation, and tooling that simplify onboarding, deployment, monitoring, and management of AI applications.
• Analyze production systems, identify performance and reliability opportunities, and drive continuous improvements through data-driven engineering decisions.
• Mentor engineers and contribute to technical strategy and engineering excellence through design reviews, knowledge sharing, and cross-team collaboration.

What This Job Offers

• Job Type: Full-time
• Career Level: Senior