Senior Software Engineer
About The Position
The AI Infrastructure Engineering Systems team at Microsoft builds the cloud platform, engineering infrastructure, and developer systems that enable teams to develop, deploy, and operate AI services at scale. The team works on build and release systems, Kubernetes, networking, observability, infrastructure automation, security, and service lifecycle management, in collaboration with AI researchers, product engineers, and hardware teams. In this hands-on technical role, you will design, implement, and ensure the reliability and quality of engineering platforms, developer tooling, and Azure integrations. The work spans architecture, design, implementation, testing, deployment, and production operations for large-scale AI training and inference platforms. You will contribute to incident management, automated validation, compute fleet efficiency, observability, and internal tooling that improves developer velocity and system reliability. The role also offers opportunities to deepen distributed-systems and cloud-platform knowledge and grow technical leadership across multidisciplinary teams.
Requirements
- Bachelor's degree in Computer Science or a related technical field and 4+ years of technical engineering experience coding in languages including C, C++, C#, Java, JavaScript, or Python, or equivalent experience.
- Experience reading, writing, and debugging high-quality production code across a large, complex codebase for internet-scale services, distributed systems, or compute platforms.
- Experience building automated validation frameworks and developer-productivity tools.
- Experience serving as a technical lead, mentoring engineers, and executing multi-team engineering initiatives.
- Experience with AI training and inference infrastructure, incident management, and reliability measures such as TTD, TTM, and TTR.
Nice To Haves
- Master's degree in Computer Science or a related technical field and 6+ years of technical engineering experience coding in C, C++, C#, Java, JavaScript, or Python, or equivalent experience.
- Bachelor's degree in Computer Science or a related technical field and 8+ years of technical engineering experience coding in C, C++, C#, Java, JavaScript, or Python, or equivalent experience.
Responsibilities
- Design, build, and optimize distributed AI platform components to improve availability, performance, scalability, reliability, and cost efficiency.
- Lead incident-management efforts and develop technical solutions to reduce Time to Detect (TTD), Time to Mitigate (TTM), and Time to Resolve (TTR) across AI training and inference workloads.
- Build and scale automated validation frameworks and test suites to identify regressions early and maintain system stability.
- Implement GPU and compute fleet optimizations that improve resource utilization, throughput, and operational efficiency at scale.
- Develop platform services, internal tools, and automation to streamline engineering workflows, improve developer velocity, and raise code quality standards.
- Write production code, build telemetry and observability tools, and debug complex system issues to resolve root causes and prevent incident recurrence.
- Provide technical leadership, mentor engineers, and lead multi-team initiatives across infrastructure, security, networking, and service teams.
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
What This Job Offers
Job Type
Full-time
Career Level
Senior
