Software Engineer II - AI Infrastructure
About The Position
Software engineer role in Cloud + AI team, enabling secure, scalable, and high-performance AI experiences across multimodal verticals, including real-time audio interaction, image generation, video generation and AI safety systems. You will contribute across the full technology stack, from APIs and platform services to the inference infrastructure serving cutting-edge AI models at massive scale. You'll work on systems that power real-world products used by millions of customers while helping advance the reliability, safety, and efficiency of AI platforms. This role is based in either Mountain View, CA or Redmond, WA. We are looking for engineers who thrive in fast-paced environments, enjoy tackling complex technical challenges, and excel in collaborative teams. Microsoft’s mission is to empower every person and every organization on the planet to achieve more. As employees we come together with a growth mindset, innovate to empower others and collaborate to realize our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond.
Requirements
- Bachelor's Degree in Computer Science or related technical field AND 2+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience.
Nice To Haves
- Master's Degree in Computer Science or related technical field AND 3+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR Bachelor's Degree in Computer Science or related technical field AND 5+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience.
- Core technical competencies: distributed systems, scalable architecture, API design, understanding of ML/AI fundamentals and practical applications, experience in delivering AI-based solutions.
- Familiarity with relevant tools, frameworks, or programming languages: Kubernetes, Azure Devops, Docker, AI / ML frameworks, Python, C++, C#, Rust, gRPC, FastAPI, Autogen, Semantic Kernel, LangChain.
- Optional experience with OpenAI API / Azure OpenAI.
- Communication and collaboration abilities.
- Problem-solving and decision-making under ambiguity.
- Strategic thinking and adaptability.
Responsibilities
- Design and build scalable, reliable architectures that meet high-performance requirements for AI systems including inference backends and API interfaces. Apply knowledge of distributed systems principles to create robust solutions.
- Dive deep into existing components to identify and resolve issues quickly. Ensure fast turnaround for critical fixes while maintaining system integrity.
- Work closely with multiple internal teams and external partners to solve complex problems, align on technical decisions, and deliver integrated solutions.
- Identify non-obvious technical approaches that unlock new possibilities. Architect and execute features with measurable goals, iterating rapidly to achieve outcomes.
- Engage with components across the entire stack—from infrastructure to APIs—to deliver end-to-end solutions.
Benefits
- Certain roles may be eligible for benefits and other compensation.
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
What This Job Offers
Job Type
Full-time
Career Level
Mid Level
