Member of Technical Staff, AI Platform Engineer - Response Quality

Microsoft • Redmond, WA

13d • Onsite

About The Position

As Microsoft continues to push the boundaries of AI, we are on the lookout for passionate individuals to work with us on the most interesting and challenging AI questions of our time. Our vision is bold and broad: to build systems that have true artificial intelligence across agents, applications, services, and infrastructure. It’s also inclusive: we aim to make AI accessible to all, from consumers to businesses to developers, so that everyone can realize its benefits.

At Microsoft AI, AI is part of everything we do. Our Evals and Response Quality team is dedicated to enabling rapid development and deployment of AI across our products. We collaborate closely with the top AI engineers in the world, working at the bleeding edge of engineering and AI research.

If you are passionate about AI, eager to work at the forefront of technology, and want to be part of a team that empowers all other teams at Microsoft Copilot to build AI products quickly and seamlessly, join us as an AI Platform Engineer!

By applying to this U.S. Redmond WA position, you are required to be local to the Redmond WA area and in office 4 days a week.

Requirements

• Bachelor's Degree in Computer Science or related technical field AND 4+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience.

Nice To Haves

• Master's degree in computer science, or related technical discipline AND 6+ years technical engineering experience building web services with coding in languages including, but not limited to: Python, Golang, Java/C#, Scala, Rust
• 1+ years of hands on experience building, deploying, or improving AI/ML systems in production.
• Strong agentic coding skills. You use AI tools daily and ship faster because of it.
• Deep experience with C# or Java.
• Experience with at least one of the following: C#/Java, Golang, or TypeScript (React/Next.js).
• Comfort with fast paced, high ambiguity environments. You default to action and iterate quickly.
• 6+ years' experience in building and releasing production software at the platform level.
• Deep experience with all of the following languages: Golang, Java/Scala, Typescript (React/Next.js)
• Experience in model pretraining, post training, evaluation, and inference
• Experience using Machine Learning frameworks, including experience using, deploying, and scaling language learning models, either personally or professionally.
• Ability to clearly communicate complex technical concepts to both technical and nontechnical stakeholders.
• Experience going from zero to one as well as working with developed systems.
• Ability to work in a fast paced environment, manage multiple priorities, and adapt to changing requirements and deadlines.
• Demonstrated interpersonal skills and ability to work closely with cross functional teams, including product managers, designers, and other engineers.
• Proven ability to collaborate and contribute to a positive, inclusive work environment, fostering knowledge sharing and growth within the team.

Responsibilities

• Build and improve systems across the response quality stack, including data pipelines, evaluation frameworks, retrieval (RAG), and inference serving.
• Design and operate our data flywheel: instrument, collect, curate, and feed production signals back into model and system improvements.
• Isolate and act on loss signals by identifying where and why quality degrades, then build the tooling and systems to fix it.
• Ship production retrieval systems by building, tuning, and scaling RAG pipelines that directly improve response quality.
• Deploy and iterate fast. Write production code in Python and TypeScript, owning it end to end from prototype to production.
• Collaborate tightly with researchers and cross functional teams to translate quality insights into shipped improvements.
• Embody our Culture and Values.

What This Job Offers

• Job Type: Full-time
• Career Level: Mid Level
• Number of Employees: 5,001-10,000 employees