Software Engineer II and Senior Software Engineer - AI Compilers

Microsoft • Redmond, WA

2d • Hybrid

About The Position

The AI Frameworks team at Microsoft develops the AI software used to train and deploy the world’s most advanced AI models. We build state-of-the-art AI compilers and design new AI programming abstractions for Microsoft’s next-generation supercomputers and the Maia-200 AI accelerator. Our interdisciplinary team operates at the intersection of compiler engineering, programming language design, algorithmic innovation, AI, and high-performance computing. Our culture is highly collaborative and we regularly partner with hardware architects, platform engineers, researchers, and other groups across Microsoft. We also participate in the open-source community. We are seeking talented and collaborative Software Engineers to join our AI Compiler group. This is a unique opportunity to join a dynamic team, working on cutting-edge technology that has a direct impact on every Microsoft business. Employees of our AI compilers team who are based in the Mountain View, CA or Redmond, WA areas can choose to work a hybrid schedule of 3 days / week in office.

Requirements

• Bachelor's Degree in Computer Science or related technical field AND 2+ years technical engineering experience with coding in languages including, but not limited to, C, C++, or Python OR equivalent experience.
• Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include, but are not limited to the following specialized security screenings: Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter.

Nice To Haves

• Master's Degree in Computer Science or related technical field AND 6+ years technical engineering experience with coding in languages including, but not limited to, C, C++, or Python OR Bachelor's Degree in Computer Science or related technical field AND 8+ years technical engineering experience with coding in languages including, but not limited to, C, C++, or Python OR equivalent experience.
• Master’s Degree or PhD in Computer Science or related technical field AND 3+ years technical software engineering experience OR Bachelor's Degree in Computer Science or related technical field AND 5+ years technical software engineering experience OR equivalent experience.
• 3+ years experience programming in C/C++.
• 1+ years experience with optimized systems‑level programming.
• Experience building compilers, using compiler frameworks like LLVM/MLIR, OR experience optimizing AI/numerical workloads, OR experience in numerical high-performance computing.
• Experience with AI frameworks, AI inference systems, AI kernel development, and AI workload optimization.

Responsibilities

• Invent and implement innovative compiler features and advanced optimization passes, leveraging tools such as LLVM, MLIR, Torch Dynamo, and Triton.
• Develop code generation techniques for new hardware platforms.
• Design and develop cutting edge AI software in C++ and Python.
• Optimize AI workloads.
• Design new programming abstractions for AI.
• Collaborate broadly across multiple disciplines from hardware architects to ML developers.
• Identify requirements, plan and design solutions, estimate effort, and schedule deliverables.
• Help establish and drive the adoption of outstanding coding standards and patterns and help enhance our inclusive engineering culture.
• Embody Microsoft's culture and values

What This Job Offers

• Job Type: Full-time
• Career Level: Mid Level
• Number of Employees: 5,001-10,000 employees