Senior and/or Principal Software Engineer - AI Infrastructure

Microsoft • Redmond, WA

6d • $119,800 - $304,200

About The Position

Microsoft’s AI Infrastructure organization builds foundational platforms, services, programming models, and developer experiences that power applications using Generative AI. Its platforms support customer AI workloads and products across Microsoft and enterprise customers. The Senior and/or Principal Software Engineer will help define engineering systems and developer productivity by building high-scale distributed services for large-scale model training and inference. The role involves developing services for machine-learning solutions on distributed platforms designed for continuous availability and tight service-level agreements, and delivering comprehensive solutions for customers.

Requirements

• Bachelor’s degree in Computer Science or a related technical field and at least 4 years of technical engineering experience coding in languages such as C, C++, C#, Java, JavaScript, or Python, or equivalent experience.
• Ability to meet Microsoft, customer, and/or government security screening requirements, including passing the Microsoft Cloud Background Check upon hire or transfer and every two years thereafter.

Nice To Haves

• Master’s degree in Computer Science or a related technical field and at least 8 years of technical engineering experience coding in languages such as C, C++, C#, Java, JavaScript, or Python; or a bachelor’s degree in Computer Science or a related technical field and at least 12 years of such experience; or equivalent experience.
• Knowledge of and hands-on experience with large-model training systems.
• At least 3 years of experience operating and designing systems that support large-model training.
• Experience with distributed systems and architecture.
• Knowledge of AI infrastructure and workloads.

Responsibilities

• Architect, design, and develop core compute services powering Azure Machine Learning to address AI problems using state-of-the-art large language models and open-source models.
• Architect, design, and develop AI infrastructure services supporting large-scale AI training and inference.
• Develop, test, and maintain backend services in C#, Go, Rust, or C++, hosted on Kubernetes clusters and Docker containers.
• Develop and operate training and inference infrastructure frameworks and machine-learning systems.
• Improve systems and applications for stability, efficiency, maintainability, low latency, and cloud security.
• Provide operational support and direct responsible individual (DRI) responsibilities for the product.
• Collaborate with engineers, data scientists, Microsoft Research teams, and external enterprises to develop solutions.
• Provide vision, expertise, and technical leadership to other team members.

Benefits

• Certain roles may be eligible for benefits and other compensation; further information is provided through Microsoft’s corporate pay and benefits page.

What This Job Offers

• Job Type: Full-time
• Career Level: Senior