Senior Software Engineer - CoreAI (Foundry Observability)

Microsoft•Redmond, WA

14h

About The Position

Microsoft’s CoreAI organization builds foundational platforms, services, programming models, and developer experiences for applications powered by generative AI. Within CoreAI, the Foundry Observability team builds observability, evaluation, and optimization capabilities spanning model inferencing, AI services, model customization, and agentic solutions. The Senior Software Engineer will build and evolve large-scale, cloud-native systems supporting the lifecycle of advanced agentic applications, including secure enterprise deployment, governed tool integration, fine-tuning and training workflows, and production observability, evaluation, and optimization. The work supports developers and enterprises in building reliable, autonomous, high-impact AI agents. The role contributes to a collaborative engineering culture through design discussions, code reviews, and work with partner teams across CoreAI and Azure. It offers the opportunity to expand technical scope while building platforms for intelligent agent systems at scale.

Requirements

Bachelor's degree in Computer Science or a related technical field and 4+ years of technical engineering experience coding in languages such as C, C++, C#, Java, JavaScript, or Python, or equivalent experience.
Ability to meet Microsoft, customer, and/or government security screening requirements, including passing the Microsoft Cloud Background Check upon hire or transfer and every two years thereafter.

Nice To Haves

Master's degree in Computer Science or a related technical field and 6+ years of technical engineering experience coding in languages such as C, C++, C#, Java, JavaScript, or Python; or a bachelor's degree in the field and 8+ years of such experience; or equivalent experience.
5+ years of technical engineering experience designing and delivering highly available, large-scale cloud services and distributed systems.
Demonstrated proficiency in leveraging AI to build systems and a passion for making this technology accessible to everyone.
3+ years of technical engineering experience with machine learning or AI systems.

Responsibilities

Lead the design, development, and delivery of large-scale AI services and platforms, emphasizing scalability, reliability, security, and performance.
Design and implement distributed systems and cloud services that run agents reliably at enterprise scale.
Drive innovation in observability, automation, deployment safety, and operational efficiency through reusable platforms and frameworks.
Improve developer and researcher workflows with better tooling, abstractions, and automation across fine-tuning, evaluation, and optimization.
Debug and optimize interactions across models, data, and infrastructure.
Contribute to technical design and implementation across the software development lifecycle.
Maintain high standards for code quality, testing, reliability, and operational excellence.
Collaborate with partner teams across CoreAI and Azure to deliver production-ready platform capabilities.
Participate in design discussions, code reviews, and collaboration across teams.