Senior Software Engineer
About The Position
The AI Infrastructure Engineering Systems team at Microsoft builds the cloud platform, engineering infrastructure, and developer systems that enable teams to develop, deploy, and operate AI services at scale. The role contributes foundational capabilities across build and release systems, Kubernetes, networking, observability, infrastructure automation, security, and service lifecycle management, working with AI researchers, product engineers, and hardware teams to support reliable paths from development to production. This hands-on technical role designs, implements, and ensures the reliability and quality of engineering platforms, developer tooling, and Azure integrations. It spans architecture, design, implementation, testing, deployment, and production operations for large-scale AI training and inference platforms. The engineer contributes to incident management, automated validation, compute fleet efficiency, observability, and internal tooling that improves developer velocity and system reliability, while developing technical leadership across multidisciplinary teams.
Requirements
- Bachelor's degree in Computer Science or a related technical field and 4+ years of technical engineering experience coding in languages such as C, C++, C#, Java, JavaScript, or Python, or equivalent experience.
- Experience reading, writing, and debugging high-quality production code across a large, complex codebase for internet-scale services, distributed systems, or compute platforms.
- Experience building automated validation frameworks and developer-productivity tools.
- Experience serving as a technical lead, mentoring engineers, and executing multi-team engineering initiatives.
- Experience with AI training and inference infrastructure, incident management, and reliability measures such as TTD, TTM, and TTR.
Nice To Haves
- Master's degree in Computer Science or a related technical field and 6+ years of technical engineering experience coding in languages such as C, C++, C#, Java, JavaScript, or Python.
- Bachelor's degree in Computer Science or a related technical field and 8+ years of technical engineering experience coding in languages such as C, C++, C#, Java, JavaScript, or Python, or equivalent experience.
Responsibilities
- Design, build, and optimize distributed AI platform components to improve availability, performance, scalability, reliability, and cost efficiency.
- Lead incident-management efforts and develop technical solutions to reduce Time to Detect (TTD), Time to Mitigate (TTM), and Time to Resolve (TTR) across AI training and inference workloads.
- Build and scale automated validation frameworks and test suites to identify regressions early and maintain system stability.
- Implement GPU and compute fleet optimizations to improve resource utilization, throughput, and operational efficiency at scale.
- Develop platform services, internal tools, and automation to streamline engineering workflows, improve developer velocity, and raise code quality standards.
- Write production code, build telemetry and observability tools, and debug complex system issues to resolve root causes and prevent incident recurrence.
- Provide technical leadership, mentor engineers, and lead multi-team initiatives across infrastructure, security, networking, and service teams.
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
What This Job Offers
Job Type
Full-time
Career Level
Senior
