Software Engineer | AI Infra

Microsoft AI • Mountain View, NY

2d • Hybrid

About The Position

Microsoft AI is seeking a Software Engineer to help build state-of-the-art large language models and the infrastructure that supports them. The role spans engineering and research, including model architecture, data curation, training and inference infrastructure, evaluation protocols, alignment, and reinforcement learning from human feedback (RLHF). The work contributes to AI models powering Microsoft products and is intended to help develop capable, controllable, safety-aligned systems that amplify human potential.

The position is part of a fast-paced, design-driven product development environment. Microsoft AI employees who live within 50 miles of a designated U.S. office or 25 miles of a designated non-U.S. office are expected to work from that office at least four days per week starting January 26, 2026, subject to local law and jurisdiction-specific variation.

Requirements

• Bachelor’s degree in Computer Science or a related technical field and 4+ years of technical engineering experience coding in languages such as C, C++, C#, Java, JavaScript, or Python, or equivalent experience.

Nice To Haves

• Master’s degree in Computer Science or a related technical field and 6+ years of technical engineering experience coding in languages such as C, C++, C#, Java, JavaScript, or Python; or a bachelor’s degree in Computer Science or a related technical field and 8+ years of such experience, or equivalent experience.
• Experience with generative AI.
• Experience with distributed computing.
• Experience leading technical projects and supporting architectural decisions with data.

Responsibilities

• Develop software systems for pre-training and post-training infrastructure, including benchmarking systems, evaluation, routing, and backend systems.
• Gather data and insights to develop the LLM training compute roadmap.
• Contribute to the development of AI models that power Microsoft products.
• Find ways to overcome roadblocks and deliver work to users quickly and iteratively.
• Work in a fast-paced, design-driven product development cycle.
• Embody Microsoft’s culture and values.

Benefits

• Certain roles may be eligible for benefits and other compensation; details are available through the Microsoft careers pay and benefits information page.

What This Job Offers

• Job Type: Full-time
• Career Level: Mid Level