Cloud Principal Hardware Engineer

Microsoft•Aliso Viejo, CA

About The Position

Microsoft Silicon, Cloud Hardware, and Infrastructure Engineering (SCHIE) delivers infrastructure and foundational technologies for Microsoft’s online businesses and Azure platform. Within SCHIE, the Azure Memory and Storage Center of Excellence provides memory and storage solutions and leads Azure Fault Prediction and Detection (AFPD), a platform that predicts, detects, and repairs hardware failures across the Azure fleet. The Cloud Principal Hardware Engineer will scale AFPD across hardware components and lead hands-on hardware resiliency. The role turns hardware, firmware, and operating-system telemetry into early failure detection and prediction, helps move workloads off failing nodes, and enables targeted repairs. Repair results and supplier failure analyses are used to improve detection rules and models. The engineer will set hardware direction for a platform used across production infrastructure and partner with Azure engineering, component teams, and hardware suppliers to improve fleet availability and customer uptime.

Requirements

  • Bachelor’s degree in Computer Science or a related technical field and 6+ years of technical engineering experience coding in languages such as C, C++, C#, Java, JavaScript, or Python, or equivalent experience.
  • Ability to meet Microsoft, customer, and/or government security screening requirements, including passing the Microsoft Cloud Background Check upon hire or transfer and every two years thereafter.

Nice To Haves

  • Master’s degree in Electrical Engineering, Computer Engineering, Mechanical Engineering, or a related field and 7+ years of technical engineering experience; or a bachelor’s degree in one of these fields and 8+ years of technical engineering experience; or equivalent experience.
  • 6+ years of hands-on failure analysis, debugging, or reliability engineering for server or datacenter hardware, covering two or more server component types.
  • 3+ years leading root-cause analysis and corrective actions with hardware suppliers, OEMs, or ODMs.
  • 2+ years using AI or machine learning in hardware engineering, such as failure analysis, telemetry analysis, or automation.
  • 10+ years in server hardware reliability, failure analysis, or fleet resiliency at cloud or datacenter scale.
  • Technical depth in the failure modes of at least one server component type, with working knowledge across the rest of the server, including BMC, PCIe, and firmware.
  • Experience turning failure signatures into automated detection rules, fault codes, or repair procedures for a large fleet.
  • Experience with predictive maintenance or anomaly detection on hardware telemetry, including setting precision targets and automated repair actions.
  • Proficiency with Kusto (Azure Data Explorer) or SQL, and Python or PowerShell, for large-scale telemetry analysis.
  • Experience with NPI and hardware qualification for server platforms.

Responsibilities

  • Lead failure analysis across server components by characterizing failure modes from fleet telemetry and logs and confirming root causes using repair results and supplier failure analysis.
  • Define signals, thresholds, targeted diagnostics, and repair recipes, and work with component teams on root cause analysis.
  • Improve failure isolation accuracy and the effectiveness of detection and repair services.
  • Partner with software engineers and data scientists on detection rules and prediction models; set precision targets and validation gates before production deployment.
  • Use AI agents and machine learning to automate failure analysis, live-site triage, and supplier root-cause follow-up, and shorten the time from a new failure signature to a detection rule.
  • Lead root-cause investigations and corrective actions for server components, including firmware fixes, and feed findings back into the platform.
  • Serve as the senior hardware escalation point for live-site incidents, from triage through root cause and fleet-wide mitigation.
  • Prepare new server generations and AI/GPU platforms for production with detection, isolation, and repair coverage at launch.
  • Track and improve metrics and mentor engineers across the team.

Benefits

  • Certain roles may be eligible for benefits and other compensation; additional benefits and pay information is available through the Microsoft careers website.
© 2026 Teal Labs, Inc
Privacy PolicyTerms of Service