Principal Software Engineer
About The Position
Microsoft is leading the AI transformation, and the Copilot, Agents, and Platform (CAP) organization is at the forefront of this change. We power mission-critical Microsoft 365 and Dynamics 365 services, including BizChat, Work IQ, Agent 365, and the agent runtime for the next era of work. Our M365 Core AI Inferencing Engineering team is seeking a Principal Software Engineer to help build and operate hyperscale, high-performance, cost-efficient, and compliant AI infrastructure that powers Microsoft's Large Language Model (LLM) services across various products. This role offers the opportunity to work on cutting-edge AI technologies with significant impact, enabling engineers and applied scientists to rapidly develop AI-powered innovations in a compliant, reliable, and cost-efficient manner.
Requirements
- Bachelor's Degree in Computer Science or related technical field AND 8+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience.
- Ability to meet Microsoft, customer and/or government security screening requirements.
- Must pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter.
Nice To Haves
- Master's Degree in Computer Science or related technical field AND 8+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python
- OR Bachelor's Degree in Computer Science or related technical field AND 12+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python
- OR equivalent experience.
- Solid software engineering skills with proficiency in Python and/or C#/.NET.
- Experience leading technical projects and driving execution across complex engineering environments.
- Solid technical expertise demonstrated through experience in two or more of the following areas: Building and operating hyperscale cloud services (4+ years). Large Language Models (LLMs), AI orchestration frameworks, embedding models, and vector databases. Distributed systems design and implementation. Event-driven and message-based architectures. High-scale OLTP or OLAP storage systems.
- Experience leading complex initiatives that span multiple engineering teams or organizations.
- Passion for AI technologies and delivering reliable, scalable, and cost-efficient customer experiences.
Responsibilities
- Lead, mentor, and grow a high-performing team of engineers, fostering excellence, engagement, and continuous learning.
- Drive the design, development, and delivery of the AI Inferencing platform that powers AI experiences for millions of customers.
- Own platform cost efficiency, availability, and operational excellence, setting an industry-leading standard for reliability and performance.
- Coach engineers in building and operating large-scale distributed systems that serve hundreds of millions of users worldwide.
- Collaborate across product and engineering teams throughout Copilot, Power Platform, Business Applications, and Microsoft to deliver innovative AI solutions.
Benefits
- Certain roles may be eligible for benefits and other compensation.
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
What This Job Offers
Job Type
Full-time
Career Level
Principal
