Sr. Staff Site Reliability Engineer

Palo Alto Networks•Office - USA - CA - Headquarters, CA

6d•$126,500 - $204,600

About The Position

The Cortex team builds and delivers Palo Alto Networks’ SecOps platform, including XDR, XSIAM, XSOAR, and XPANSE. As a member of the Cortex DevOps team, this role operates and maintains a large-scale GCP environment and designs, implements, and continuously improves observability systems. The role requires deep knowledge of modern observability and monitoring, including managing high-cardinality metrics, implementing tracing, and operating large-scale logging solutions. It works closely with engineering teams to create actionable insights into system performance and health. The Senior Staff SRE on the Cortex Observability team uses cloud-platform monitoring expertise, particularly with GCP and cloud-native technologies, to optimize infrastructure. The role improves monitoring processes, alerts, and metrics; supports efficient incident resolution; automates monitoring and cloud operations; evaluates and adopts relevant technologies; provides follow-the-sun operational coverage for production observability infrastructure; and collaborates with engineering to improve product operability, reliability, and availability.

Requirements

Deep knowledge of modern observability and monitoring tools and practices.
Experience managing high-cardinality metrics.
Experience implementing tracing.
Experience operationalizing large-scale logging solutions.
Expertise in monitoring cloud platforms, particularly GCP.
Ability to collaborate with engineering and development teams.

Responsibilities

Operate and maintain a large-scale GCP environment.
Design, implement, and continuously enhance observability systems.
Use cloud-native technologies to monitor and optimize cloud infrastructure, particularly GCP.
Improve monitoring processes, alerts, and metrics, working with development teams to ensure services have appropriate monitoring and metrics to detect problems before customers do.
Use incident-management processes to resolve system issues efficiently and minimize service impact.
Automate complex monitoring and alerting tasks by building cloud-operations tools, including automated remediation of known issues and auto-scaling.
Evaluate emerging technologies and implement them when appropriate to improve operations.
Provide follow-the-sun operational coverage for production observability infrastructure.
Collaborate with engineering to influence product operability and ensure service reliability and availability.
Develop solutions that provide clear, actionable insights into system performance and health.