Software Engineer II - CoreAI

Microsoft • Redmond, WA

2d

About The Position

As an AI Engineer on the CoreAI Platform team, you will apply artificial intelligence to solve real, production‑critical problems across Microsoft’s AI systems. You will use AI/ML models, statistical modeling, intelligent automation to detect anomalies, identify emerging patterns, and predict system behaviors before they impact customers. Your work will drive reliability, performance, and efficiency across AI model-serving pipelines which power experience such as Copilot and Azure OpenAI Foundry models.
This is working at the intersection of C++ systems and AI model serving pipelines and your work will increase overall engineering velocity. We value engineers who think systemically, communicate clearly, and thrive in an ambiguous problem space.

Requirements

• Bachelor's Degree in Computer Science or related technical field AND 2+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience.
• Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include but are not limited to the following specialized security screenings:
• Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter.

Nice To Haves

• Master's Degree in Computer Science or related technical field AND 3+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR Bachelor's Degree in Computer Science or related technical field AND 5+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience.
• 2+ years of experience in Python for AI automation
• 1+ year(s) of experience in AI to build solutions using toolchains and frameworks in Python, C++ and Kubernetes (K8s)
• 1+ year(s) of experience demonstrating a grasp of Large Language Model (LLM) post-training techniques, inference optimization, and application-layer use cases
• Familiarity with embeddings, semantic search, or LLMbased analysis used for system intelligence or reasoning.
• Familiarity with agentic frameworks (LangChain, Autogen, DSPy)
• Exposure to React or frontend observability dashboards is a plus
• Persuasive communication and collaboration abilities; comfortable working in ambiguous, fast-moving environments.

Responsibilities

• AI-Driven Problem Solving
• Design, build, and scale AI models to detect anomalies, identify regressions across large-scale AI systems.
• Analyze patterns in telemetry, logs, and real‑time signals to uncover root causes, predict failures, and drive proactive mitigations.
• Apply AI to identify emerging usage trends, performance hotspots, and workload irregularities that impact system health and user experience.
• Platform Coding
• Build lightweight automation that leverages anomaly detection signals and pattern analysis to improve live‑site reliability and engineering velocity.
• Contribute to hotfixes, performance tuning, and reliability improvements in production AI engines (e.g., GPU savings, SLA reliability, customer satisfaction).
• Build intuitive, responsive UI components for AI dashboards and telemetry tools using React and modern web technologies.
• Collaboration & Impact
• Communicate technical concepts with clarity and initiative, proactively seeking feedback and driving continuous improvement.
• Stay current with industry trends in applied AI, observability, and performance engineering.

Benefits

• Certain roles may be eligible for benefits and other compensation. Find additional benefits and pay information here: https://careers.microsoft.com/us/en/us-corporate-pay

What This Job Offers

• Job Type: Full-time
• Career Level: Mid Level
• Number of Employees: 5,001-10,000 employees