Senior Software Engineer - CoreAI (Foundry Observability)

Microsoft • Redmond, WA

1d • $119,800 - $304,200

About The Position

The Senior Software Engineer will join Microsoft’s CoreAI Foundry Observability team, which builds observability, evaluation, and optimization capabilities across AI model inferencing, AI services, model customization, and agentic solutions. The role involves building and evolving large-scale, cloud-native systems that support the full lifecycle of advanced agentic applications, including secure enterprise deployment, governed tool integration, fine-tuning and training workflows, and production observability, evaluation, and optimization. The work contributes to helping developers and enterprises build reliable, autonomous AI agents.

The engineer will lead development of large-scale AI services and platforms, design distributed systems and cloud services for enterprise-scale agents, and improve observability, deployment safety, operational efficiency, and developer and researcher workflows. The position involves collaboration with CoreAI and Azure partner teams and participation in design discussions, code reviews, and engineering collaboration.

Microsoft emphasizes a growth mindset, innovation, collaboration, respect, integrity, accountability, and an inclusive work environment. The role requires passing a Microsoft Cloud background check upon hire or transfer and every two years thereafter.

Requirements

• Bachelor’s degree in Computer Science or a related technical field and 4+ years of technical engineering experience coding in languages such as C, C++, C#, Java, JavaScript, or Python, or equivalent experience.
• Ability to meet Microsoft, customer, and/or government security screening requirements, including passing the Microsoft Cloud Background Check upon hire or transfer and every two years thereafter.

Nice To Haves

• Master’s degree in Computer Science or a related technical field and 6+ years of technical engineering experience coding in languages such as C, C++, C#, Java, JavaScript, or Python; or a bachelor’s degree in a related field and 8+ years of such experience; or equivalent experience.
• 5+ years of technical engineering experience designing and delivering highly available, large-scale cloud services and distributed systems.
• Demonstrated proficiency in leveraging AI to build systems and a passion for making this technology accessible to everyone.
• 3+ years of technical engineering experience with machine learning or AI systems.

Responsibilities

• Lead the design, development, and delivery of large-scale AI services and platforms, focusing on scalability, reliability, security, and performance.
• Design and implement distributed systems and cloud services to run agents reliably at enterprise scale.
• Drive innovation in observability, automation, deployment safety, and operational efficiency through reusable platforms and frameworks.
• Improve developer and researcher workflows through better tooling, abstractions, and automation across fine-tuning, evaluation, and optimization.
• Debug and optimize interactions across models, data, and infrastructure.
• Contribute to technical design and implementation across the software development lifecycle.
• Maintain high standards for code quality, testing, reliability, and operational excellence.
• Collaborate with partner teams across CoreAI and Azure to deliver production-ready platform capabilities.
• Participate in design discussions, code reviews, and collaboration across teams.

What This Job Offers

• Job Type: Full-time
• Career Level: Senior