Principal Architect

Microsoft • Redmond, WA

4d • $165,600 - $331,200 • Hybrid

About The Position

Copilot Tuning is a new AI product that adapts based on tenant data, enabling customer-specific agents and solutions. We are a small, nimble team advancing the state of the art of models in M365 Copilot and helping transform the large language model experience in the enterprise.
The mission of the Copilot Tuning team is to ensure that AI can be easily adapted and tuned to enable critical, high-value applications, including entirely new productivity tools. Our work leverages novel training and post-training algorithms, AI architecture, agentic innovations, customer-specific data, and domain expert feedback to enable end-to-end fine-tuning and adaptation within the M365 Copilot platform.
We are seeking a Principal Architect to lead architecture strategy for systems efficiency and cost-of-goods-sold improvements across the Copilot Tuning and Frontier Tuning stack. This role will drive platform-wide efficiency across training, post-training, inference, serving, orchestration, evaluation, data pipelines, and infrastructure utilization. The ideal candidate is a deep systems thinker who can connect model architecture, platform design, infrastructure, product requirements, and business outcomes to deliver measurable efficiency gains at frontier AI scale.
This position is a part-time role - 3 days week, and based in Redmond, Washington and requires the employee be in the office a minimum of 3 days per week.
Microsoft’s mission is to empower every person and every organization on the planet to achieve more. As employees we come together with a growth mindset, innovate to empower others, and collaborate to realize our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond.

Requirements

• Bachelor's Degree in Computer Science or related technical field AND 8+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience.
• Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include but are not limited to the following specialized security screenings: Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter.

Nice To Haves

• Master's Degree in Computer Science or related technical field AND 12+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR Bachelor's Degree in Computer Science or related technical field AND 15+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience.
• Experience designing, building, or operating cloud-scale systems with measurable impact on performance, reliability, scalability, or cost efficiency.
• Experience with AI/ML systems, large-scale data systems, model serving, inference platforms, training infrastructure, or distributed compute systems.
• Deep experience optimizing cost, latency, throughput, reliability, and infrastructure utilization in production systems.
• Experience with large language models, generative AI, model training, post-training, fine-tuning, reinforcement learning, inference optimization, or model serving.
• Experience with GPU/accelerator-based systems, capacity planning, distributed training, high-throughput inference, or AI infrastructure efficiency.
• Experience building platform capabilities that reduce operational burden and enable many teams or customers to scale efficiently.
• Demonstrated ability to reason quantitatively about architectural tradeoffs, including COGS, quality, performance, reliability, and customer value.
• Proven ability to influence senior technical leaders and align organizations around long-term architecture strategy.
• Experience working at the intersection of research, product, engineering, and infrastructure teams.
• Written and verbal communication skills, with the ability to explain complex architecture decisions to technical and non-technical stakeholders.

Responsibilities

• Define and drive the end-to-end architecture strategy for improving systems efficiency and reducing COGS across Copilot Tuning and Frontier Tuning.
• Lead cross-stack architectural investments spanning model training, post-training, inference, serving, orchestration, data movement, evaluation, capacity planning, and infrastructure utilization.
• Identify architectural simplifications, reusable platform capabilities, and systems optimizations that improve scalability, reliability, performance, and cost efficiency.
• Partner with research, engineering, product, finance, capacity, and infrastructure teams to make quantitative tradeoffs across cost, latency, quality, reliability, and customer impact.
• Establish metrics, mechanisms, and governance for measuring efficiency gains, COGS impact, platform leverage, and operational sustainability.
• Drive technical direction across multiple teams and organizations, influencing roadmap decisions and aligning stakeholders around durable architectural investments.
• Translate ambiguous business and technical goals into clear architecture plans, execution milestones, and measurable outcomes.
• Document and share architecture patterns, best practices, and efficiency mechanisms across the organization.
• Mentor and grow senior technical talent; model technical excellence, inclusive collaboration, and high standards for system design.
• Embody Microsoft’s culture and values.

Benefits

• Certain roles may be eligible for benefits and other compensation. Find additional benefits and pay information here: https://careers.microsoft.com/us/en/us-corporate-pay

What This Job Offers

• Job Type: Part-time
• Career Level: Principal