Staff Site Reliability Engineer

Cisco•San Francisco, CA

2d•Hybrid

About The Position

The Splunk Agent Resilience team develops scalable, cost-effective evaluation and guardrails to help ensure AI agents behave as intended, improving reliability and reducing risk. The team’s unified approach helps customers deploy and manage AI-powered applications with enhanced observability and control. As a Staff Site Reliability Engineer, you will provide technical leadership for the reliability, scalability, and operational architecture of Splunk Agent Observability’s platform. You will define the long-term reliability strategy, lead major infrastructure initiatives, and advance engineering excellence across deployment automation, production operations, and platform resiliency. You will own complex production systems, influence engineering direction across teams, and establish best practices for operating large-scale cloud and on-premises deployments.

Requirements

At least 6 years of experience in Site Reliability Engineering, Platform, Cloud, Infrastructure Engineering, or related fields.
At least 5 years operating large-scale Kubernetes platforms in production.
Experience designing highly available, scalable, and resilient distributed systems.
Experience with AWS, GCP, or other public cloud platforms.
Strong experience designing CI/CD platforms and deployment automation at scale.
At least 8 years of experience with a bachelor's degree, 6 or more years with a master's degree, or 3 or more years with a PhD; equivalent related experience is also accepted.

Nice To Haves

Expertise in observability, monitoring, alerting, capacity planning, and performance engineering.
Strong programming skills in Python and/or Go.
Deep experience with Infrastructure as Code, such as Terraform.
Experience with MLOps.
Strong understanding of networking, distributed systems, storage, databases, and cloud architecture.
Experience operating both SaaS and enterprise/on-premises deployments.
Demonstrated technical leadership across multiple engineering teams.
Experience leading incident management, postmortems, and long-term reliability initiatives.

Responsibilities

Define and drive the technical roadmap for platform reliability, scalability, and operational excellence.
Lead the architecture and evolution of deployment platforms supporting cloud and air-gapped customer environments.
Establish reliability engineering standards, including service level objectives (SLOs), operational readiness, capacity planning, and resiliency reviews.
Lead major reliability and scalability initiatives across Kubernetes, deployment infrastructure, databases, and networking.
Drive automation to eliminate operational toil and improve engineering productivity.
Design and build internal platforms, frameworks, and tooling that enable reliable operations at scale.
Lead complex production incident response and drive systemic improvements through root cause analysis and long-term remediation.
Partner with engineering leadership to influence platform architecture, deployment strategy, and production readiness.
Mentor engineers and raise the engineering bar through technical leadership, design reviews, and operational guidelines.
Collaborate with customers and internal teams to build secure, scalable, and highly reliable deployment architectures for cloud and on-premises environments.

Benefits

Medical insurance
Dental insurance
Vision insurance
401(k) plan with Cisco matching contribution
Paid parental leave
Short- and long-term disability coverage
Basic life insurance
Paid holidays and a floating holiday for non-exempt employees
Paid day off for employee's birthday
Paid year-end holiday shutdown
Paid personal wellness days
Paid vacation or flexible vacation time off, depending on employee classification
Sick time off
Additional paid time away may be requested for critical or emergency family issues
Optional paid volunteer days
Annual bonuses for eligible non-sales employees, subject to Cisco policies
Potential Cisco restricted stock unit grants, subject to eligibility and continued employment