Software Engineer II - AI Infrastructure

Microsoft • Redmond, WA

2d • $102,100 - $219,200

About The Position

The Software Engineer II will work on Microsoft’s Cloud + AI team to enable secure, scalable, high-performance AI experiences across multimodal areas, including real-time audio interaction, image and video generation, and AI safety systems. The role contributes across the technology stack, from APIs and platform services to inference infrastructure serving advanced AI models at scale. The engineer will help power products used by millions of customers and improve the reliability, safety, and efficiency of AI platforms. The position is based in Mountain View, California, or Redmond, Washington.

Requirements

• Bachelor’s degree in Computer Science or a related technical field and at least 2 years of technical engineering experience coding in languages such as C, C++, C#, Java, JavaScript, or Python, or equivalent experience.
• Knowledge of distributed systems, scalable architecture, API design, and ML/AI fundamentals and practical applications.
• Experience delivering AI-based solutions.
• Communication and collaboration abilities.
• Problem-solving and decision-making skills in ambiguous situations.
• Strategic thinking and adaptability.

Nice To Haves

• Master’s degree in Computer Science or a related technical field and at least 3 years of technical engineering experience coding in languages such as C, C++, C#, Java, JavaScript, or Python; or a bachelor’s degree in Computer Science or a related technical field and at least 5 years of such experience; or equivalent experience.
• Familiarity with Kubernetes, Azure DevOps, Docker, AI/ML frameworks, Python, C++, C#, Rust, gRPC, FastAPI, AutoGen, Semantic Kernel, or LangChain.
• Experience with the OpenAI API or Azure OpenAI.

Responsibilities

• Design and build scalable, reliable architectures for AI systems, including inference backends and API interfaces, meeting high-performance requirements and applying distributed-systems principles.
• Investigate existing components, identify and resolve issues quickly, and deliver critical fixes while maintaining system integrity.
• Collaborate with internal teams and external partners to solve complex problems, align on technical decisions, and deliver integrated solutions.
• Identify technical approaches that enable new possibilities; architect and execute features with measurable goals, iterating rapidly to achieve outcomes.
• Work across the stack, from infrastructure to APIs, to deliver end-to-end solutions.

Benefits

• Certain roles may be eligible for benefits and other compensation; further details are available through the linked Microsoft careers pay-information page.

What This Job Offers

• Job Type: Full-time
• Career Level: Mid Level