Senior Software Engineer, AI Infrastructure

Microsoft • Redmond, WA

6d

About The Position

Join Microsoft's AI infrastructure team to build the platform that routes AI traffic across global infrastructure, helping services such as Azure OpenAI and Microsoft Copilot remain fast and reliable. You will design, build, and operate services that route and prioritize AI requests and match them to available computing capacity. You will own the design of key platform components, work with partner teams to bring new AI models and capabilities to customers, and help maintain production service health. The role offers the opportunity to deepen expertise in globally distributed systems and AI model serving, while growing as a technical leader and mentor.

Microsoft’s mission is to empower every person and every organization on the planet to achieve more. Employees are expected to bring a growth mindset, innovate, collaborate, and uphold the values of respect, integrity, and accountability in an inclusive culture.

Requirements

• Bachelor's degree in Computer Science or a related technical field and 4+ years of technical engineering experience building distributed systems, coding in languages such as C#, Java, or Go, or equivalent experience.
• Ability to meet Microsoft, customer, and/or government security screening requirements, including passing the Microsoft Cloud Background Check upon hire or transfer and every two years thereafter.

Nice To Haves

• Master's degree in Computer Science or a related technical field and 6+ years of technical engineering experience building distributed systems with C#, Java, Go, or similar, or a bachelor's degree in a related field and 8+ years of such experience, or equivalent experience.
• 3+ years of experience running distributed services on public cloud platforms such as Microsoft Azure, AWS, or GCP.
• 2+ years of experience with systems that route or schedule traffic or allocate computing resources.
• Experience with Python, Docker, and Kubernetes.
• Experience with AI or machine-learning infrastructure, such as serving models in production or managing GPU fleets.
• Experience delivering projects with partner teams from design through launch and operation.
• Experience being on call for highly available services and improving monitoring to reduce incidents.

Responsibilities

• Own the design of platform components for routing AI traffic and managing computing capacity; write design proposals, compare options, and ensure designs meet speed, reliability, scale, and cost goals.
• Write clear, secure, well-tested code and provide thoughtful, timely code reviews that help teammates grow.
• Break work into dependable milestones with program managers; use feature flags and gradual rollouts to test changes, measure impact, and roll back when needed.
• Participate in the on-call rotation as a designated responsible individual (DRI); add monitoring and dashboards, improve troubleshooting guides, and help reduce incidents.
• Work with product managers and partner teams to understand customer needs and translate them into technical requirements.
• Build security, privacy, and compliance into work from design through deployment; automate testing and releases, and share learning with the team.
• Use AI tools across the software development lifecycle, including coding, testing, and live-issue investigation; take responsibility for AI-generated work and help teammates do the same.
• Embody Microsoft's culture and values.

What This Job Offers

• Job Type: Full-time
• Career Level: Senior