Principal Software Engineer, Foundry Agents - CoreAI
About The Position
Microsoft Foundry is building the foundational platforms that power the next generation of intelligent agents and generative AI systems. Within CoreAI, the Foundry Agents organization is responsible for key ownership areas across the end-to-end agent lifecycle: (a) Foundry Agents platform to deploy and run agents securely at enterprise scale with seamless integration with governed tools, (b) model fine-tuning to train and improve agentic performance, and (c) Foundry observability to generate insights from agentic traces and continuously evaluate and optimize agents. As a senior engineer within Foundry Agents, you will help build and evolve large-scale, cloud-native systems that span the full lifecycle of advanced agentic applications — from secure enterprise deployment and governed tool integration, to fine-tuning and training loops, to deep observability, evaluation, and optimization in production. Your work will directly shape how developers and enterprises build reliable, autonomous, and high-impact AI agents. You will operate at the intersection of distributed systems, AI infrastructure, and developer platforms, owning architectural decisions for complex systems that must meet the highest standards of performance, reliability, security, and compliance. This role requires deep technical judgment, strong systems thinking, and the ability to translate evolving customer, developer, and research needs into durable platform capabilities.
Requirements
- Bachelor's Degree in Computer Science or related technical field and 6+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, Python or equivalent experience.
- Ability to meet Microsoft, customer and/or government security screening requirements are required for this role.
- These requirements include but are not limited to the following specialized security screenings: Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years
Nice To Haves
- Master's Degree in Computer Science or related technical field AND 12+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR Bachelor's Degree in Computer Science or related technical field AND 15+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience.
Responsibilities
- Build and scale foundational services that power secure agent deployment and execution, governed tool integration, training/fine-tuning, and observability/evaluation
- Design and evolve distributed runtimes and cloud services to run agents securely at enterprise scale with strong reliability, security, and compliance guarantees
- Improve iteration loops for researchers, engineers, and developers through better tooling, abstractions, and automation across fine-tuning, evaluation, and optimization
- Debug and optimize complex interactions across models, data, hardware, and infrastructure
- Drive technical direction across the full software development lifecycle, influencing design tradeoffs and long-term architecture
- Champion operational excellence, secure-by-design practices, and responsible AI at scale
- Collaborate closely with partner teams across CoreAI and Azure to deliver seamless, production-ready platforms
- Raise the engineering bar through strong design principles, rigorous reviews, mentorship, and influence across teams
- Shape how the world interacts with AI.
Benefits
- Certain roles may be eligible for benefits and other compensation.
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
What This Job Offers
Job Type
Full-time
Career Level
Senior
