Compute Orchestration & Scheduling

Microsoft AI • Mountain View, NY

2d • $119,800 - $304,200 • Hybrid

About The Position

Microsoft AI is seeking a Member of Technical Staff to build next-generation AI infrastructure for frontier model development. The Compute Orchestration & Scheduling team owns cluster orchestration, workload scheduling, resource allocation, quota management, fast initialization, and reliable fault recovery for Ray and Kubernetes workloads running on next-generation GPU supercomputers. The infrastructure spans multiple locations and a rapidly growing fleet of accelerators across hardware generations, including NVIDIA Grace Blackwell, Vera Rubin, and AMD GPU platforms, along with CPU, network, and storage infrastructure.

The role addresses challenges such as topology-aware placement, large-scale distributed training, reliable initialization of Ray and Kubernetes environments, rapid fault recovery for long-running AI jobs, deep cluster observability, and improving accelerator utilization. You will collaborate with researchers, model engineers, hardware architects, and infrastructure teams to turn frontier model development needs into scalable platform capabilities. The environment is fast-paced and design-driven, with an emphasis on navigating ambiguity and delivering solutions to users iteratively.

Microsoft AI’s mission is to build AI that amplifies human potential and advances science, education, productivity, and global well-being. Employees are expected to work from a designated Microsoft office at least four days a week if they live within 50 miles of that location in the U.S. or 25 miles outside the U.S., subject to local law and jurisdictional variation.

Requirements

• Bachelor’s degree in Computer Science or a related technical field and 6+ years of technical engineering experience coding in languages including C, C++, Python, Go, or JavaScript, or equivalent experience.
• Expertise in Ray, Kubernetes, Kueue, Volcano, or another AI-focused system for scheduling, scaling, or fault tolerance.

Nice To Haves

• Master’s degree in Computer Science or a related technical field and 8+ years of technical engineering experience coding in languages including C, C++, C#, Java, JavaScript, or Python.
• Bachelor’s degree in Computer Science or a related technical field and 12+ years of technical engineering experience coding in languages including C, C++, Python, Go, or JavaScript, or equivalent experience.

Responsibilities

• Develop and tune scalable pretraining software for NVIDIA Grace Blackwell, Vera Rubin, and AMD MIxxx architectures.
• Scale GPU clusters using Grace Blackwell, Vera Rubin, and AMD MIxxx GPUs beyond thousands of GPUs.
• Gather data and insights to develop the GPU and CPU compute roadmap for large-scale AI labs.
• Actively contribute to developing AI models that power Microsoft products.
• Deliver work to users quickly and iteratively, finding ways forward despite roadblocks.
• Work in a fast-paced, design-driven product development cycle.
• Embody Microsoft’s Culture and Values.

What This Job Offers

• Job Type: Full-time
• Career Level: Senior