AI Engineer II

Microsoft

5d

About The Position

In the 1980s, Microsoft Office revolutionized global industries and empowered the modern information worker by moving knowledge work from typewriters and physical ledgers to Microsoft Office. Today, you are looking at an opportunity at Microsoft Office AI Team to drive the next revolution in history, evolving Office from a digital tool into an intelligent copilot, as an AI Engineer. Sitting at the intersection of agentic AI and next-generation multi-modal intelligence, you are missioned to define transformative AI solutions across Microsoft 365, empowering hundreds of millions of users to work and create naturally through text, voice and vision-based experiences.
Achieving such goals requires more than just technical depth; it demands a unique mastery - the ability to deeply understand, build, and orchestrate the end-to-end intelligence that defines how AI behaves. You will step beyond traditional boundaries to operate as a multidisciplinary engineer, seamlessly bridging Software Engineering (SWE), Applied Science (AS), Product, and Design to ensure the true power of ML/LLM models are fully harnessed to translate cutting-edge capabilities into secure, reliable, and delightful user experiences. Together, you will deliver intelligent breakthrough multi-modal systems powering Copilot agentic experiences across Word, Excel, PowerPoint, and beyond.
As an AI Engineer, you will design, build, and ship production-grade agentic and/or multi-modal AI systems that integrate directly into core M365 Copilot experiences. Through your dedication, the future is in your hand to set the industry bar with autonomous agents, multi-agent frameworks, and LLM-powered workflows that fuse text, voice, and vision to translate user intent into high-quality outcomes at global scale. If you are passionate about advancing the frontiers of AI and shaping how people interact with technology, we invite you to join our mission.

Requirements

• Bachelor's degree in Computer Science, Engineering, or related technical field AND 2+ years technical engineering experience including some production experience building applications with LLMs and/or deploying ML/LLM/agent systems with coding in languages including, but not limited to, Python, Typescript/Javascript, C, C++, or C#

Nice To Haves

• 1+ year of experience training, fine-tuning, and evaluating ML/LLM models, including data preparation, experiment design, offline/online validation, and performance optimization.
• Course work, research or relevant training in ML/AI/LLMs, with a demonstrated track record of pushing into new interdisciplinary areas at the intersection of applied science, engineering, and product.
• Proven experience orchestrating agentic systems in production, including prompt design, tool/function calling, context and memory management, routing/planning, and evaluation.
• Understanding of async programming patterns, microservices architecture, and event-driven systems
• Growth mindset, resilience, and excellent communication & collaboration skills.

Responsibilities

• Prototype and iterate on AI agent experiences that reimagine Office workflows, rapidly, validating feasibility, UX, and technical approaches, while pushing the frontier of the agent-driven productivity.
• Ship features by operating at the true intersection of AS and SWE, where a single AI engineer can unlock disproportionate impact by translating model capability and product intent into intelligent, production-ready systems.
• Design and develop tools and evaluation frameworks to observe and monitor real-time agent health, investigate customer feedback, and build continuous learning systems for end-to-end AI workflows.
• Invent and lead industry-defining multimodal AI experiences across Microsoft 365 by exploring new interaction paradigms and system architectures that unlock and define natural user interface between human and AI.
• Continuous learning and stay current with advances in generative AI and software engineering. Invest time in learning new tools and frameworks, propose improvements to build processes, and share knowledge with colleagues.
• Embody Microsoft culture and values.

What This Job Offers

• Job Type: Full-time
• Career Level: Mid Level