Senior and/or Principal Software Engineer - AI Infrastructure
About The Position
AI Infra builds foundational platforms, services, programming models, and developer experiences that support the next generation of applications using Generative AI. Its platforms handle AI workloads for customers and support products across Microsoft and enterprise customers. The role focuses on defining engineering systems and developer productivity, and building high-scale distributed services for large-scale model training and inference. It involves developing services for machine-learning solutions on highly distributed platforms designed for 24x7x365 availability and tight SLAs, as well as comprehensive end-to-end solutions for customers. The engineer will contribute to the architecture, design, development, and operation of AzureML core compute and AI infrastructure services. The role includes backend development in several programming languages, operating training and inference frameworks and machine-learning systems, maintaining stability and efficiency, and providing operational support and technical leadership. The position collaborates with engineers, data scientists, Microsoft Research teams, and external enterprises.
Requirements
- Bachelor's degree in Computer Science or a related technical field and 4+ years of technical engineering experience coding in languages such as C, C++, C#, Java, JavaScript, or Python, or equivalent experience.
- Ability to meet Microsoft, customer, and/or government security screening requirements, including passing the Microsoft Cloud Background Check upon hire or transfer and every two years thereafter.
Nice To Haves
- Master's degree in Computer Science or a related technical field and 8+ years of technical engineering experience coding in languages such as C, C++, C#, Java, JavaScript, or Python, or equivalent experience.
- Bachelor's degree in Computer Science or a related technical field and 12+ years of technical engineering experience coding in languages such as C, C++, C#, Java, JavaScript, or Python, or equivalent experience.
- Knowledge and first-hand experience with large-model training systems.
- 3+ years of experience operating and designing systems that support large-model training.
- Experience in distributed systems and architecture.
- Knowledge of AI infrastructure and workloads.
Responsibilities
- Architect, design, and develop core compute services powering AzureML to address AI problems using state-of-the-art LLMs and open-source models.
- Architect, design, and develop AI infrastructure services that support large-scale AI training and inference.
- Develop, test, and maintain backend services in C#, Go, Rust, C++, or other specified programming languages, hosted on Kubernetes clusters and Docker containers.
- Develop and operate training and inference infrastructure frameworks and machine-learning systems.
- Improve systems and applications to ensure stability, efficiency, maintainability, low latency, and tight cloud security.
- Provide operational support and directly responsible individual (DRI) responsibilities for the product.
- Collaborate with engineers, data scientists, Microsoft Research teams, and external enterprises to build solutions.
- Provide vision, expertise, and technical leadership to team members.
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
What This Job Offers
Job Type
Full-time
Career Level
Senior
