Senior Principal Research Engineer

Microsoft • Redmond, WA

1d

About The Position

Copilot usage is growing rapidly across Microsoft 365 and custom agent experiences, requiring scalable and resilient AI systems. This role drives model choice across multiple providers and modalities, ensuring quality, safety, latency, and cost are balanced while reducing vendor lock‑in.
As a Senior Principal Research Engineer, you will set technical vision and build backend systems, APIs, and evaluation pipelines that enable intelligent model routing for Copilot and Copilot Studio. You’ll partner with PMs, scientists, and reliability engineers to instrument quality signals, govern rollouts, and create decision frameworks for key scenarios like authoring, reasoning, retrieval‑augmented generation, and multi‑agent orchestration.
You will productize responsible AI metrics (e.g., groundedness, coherence, relevance) into dashboards for makers and platform teams, influence cross‑org strategy, mentor senior engineers, and represent Microsoft in the global research community—delivering innovation at scale for millions of users
Microsoft’s mission is to empower every person and every organization on the planet to achieve more. As employees we come together with a growth mindset, innovate to empower others, and collaborate to realize our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond.

Requirements

• Bachelor's Degree in Computer Science or related technical field AND 8+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience.
• 1+ years of experience architecting and deploying Large Language Models (LLMs) in production at scale.
• Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include but are not limited to the following specialized security screenings: Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter.

Nice To Haves

• Master's Degree in Computer Science or related technical field AND 12+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR Bachelor's Degree in Computer Science or related technical field AND 15+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience.
• Experience building backend services or APIs in a production environment using at least one modern programming language (e.g., C#, Java, Python, or TypeScript).
• Experience deploying or operating distributed systems or cloud-based services (e.g., Azure, AWS, or GCP) in a production environment.
• Familiarity with Responsible AI frameworks and bias-mitigation techniques.
• Demonstrated ability to shape product strategy and drive organizational change.
• Experience with Microsoft’s LLMOps stack: Azure AI Foundry, Azure Machine Learning, Semantic Kernel, Azure OpenAI Service, and Azure AI Search for vector/RAG
• PhD in AI/ML or related fields with top-venue publications and/or patents.

Responsibilities

• Build multi provider model routing services with policy driven selection, traffic splitting, and observability.
• Develop evaluation pipelines for offline and online experiments; automate metrics like task success, groundedness, latency, and cost.
• Operationalize model comparisons through scorecards, dashboards, and A/B testing for rollout decisions.
• Harden backend infrastructure for scale, security, and compliance; implement caching, rate limiting, and safety filters.
• Instrument telemetry and monitoring using OpenTelemetry; enable RCA and performance insights.
• Collaborate cross functionally with PMs, scientists, and Responsible AI teams; document and evangelize best practices.

Benefits

• Certain roles may be eligible for benefits and other compensation. Find additional benefits and pay information here: https://careers.microsoft.com/us/en/us-corporate-pay

What This Job Offers

• Job Type: Full-time
• Career Level: Senior
• Number of Employees: 5,001-10,000 employees