Senior Site Reliability Engineer (SRE) (Hybrid)

Cisco•San Francisco, CA

4d•$167,700 - $245,200•Hybrid

About The Position

The Senior Site Reliability Engineer will build, operate, and continuously improve the reliability, scalability, and operational excellence of Splunk Agent Observability's deployment platform and production infrastructure. The role owns the operational backbone supporting cloud and air-gapped customer deployments, develops automation to improve operational efficiency, and partners with engineering teams to deliver reliable, secure, and scalable systems. The Splunk Agent Resilience team develops scalable, cost-effective evaluation and guardrails to help AI agents behave as intended, improving reliability and reducing risk. Its unified approach helps customers deploy and manage AI-powered applications with enhanced observability and control.

Requirements

At least 7 years of experience with a bachelor's degree, 4 years with a master's degree, or 1 year with a Ph.D., or equivalent related experience.
Experience must include at least 4 years in Site Reliability Engineering, Platform Engineering, Cloud Engineering, Infrastructure Engineering, or a related field.
At least 3 years operating Kubernetes in production and experience with Helm.
Experience building and maintaining CI/CD platforms and deployment automation.
Experience working with AWS, GCP, or similar cloud platforms.

Nice To Haves

Experience improving production reliability, scalability, and availability.
Experience with monitoring, logging, observability, and alerting platforms.
Strong scripting or programming skills in Python and/or Go.
Experience with Infrastructure as Code tools such as Terraform.
MLOps experience.
Solid understanding of networking fundamentals, including VPCs, DNS, routing, and load balancing.
Experience operating databases and tuning them for performance and reliability.
Experience deploying and supporting cloud and air-gapped/on-premises environments.
Strong debugging and troubleshooting skills across distributed systems.

Responsibilities

Operate and improve Kubernetes-based production infrastructure and deployment systems.
Own customer deployments across cloud and air-gapped environments, including installation, upgrades, troubleshooting, and lifecycle management.
Build and improve deployment observability, monitoring, logging, and alerting.
Improve reliability, scalability, and operational efficiency through automation and performance optimization.
Participate in production incident response, root cause analysis, and reliability improvements.
Tune infrastructure components, including databases and services, to improve performance and resilience.
Design and develop internal tooling using Python and/or Go.
Debug complex production issues across Kubernetes, networking, storage, and application layers.
Manage infrastructure using Terraform or similar Infrastructure as Code tools.
Collaborate with software engineers and customers to design secure, scalable, and reliable deployment architectures.

Benefits

Medical, dental, and vision insurance.
401(k) plan with a Cisco matching contribution.
Paid parental leave.
Short- and long-term disability coverage.
Basic life insurance.
Cisco restricted stock unit grants may be available, subject to eligibility and continued employment.
Paid holidays and a floating holiday for non-exempt employees.
Paid birthday leave, year-end holiday shutdown, and personal wellness days.
Paid vacation time for non-exempt employees; eligible exempt employees participate in a flexible vacation program with no defined limit, subject to availability and business limitations.
Sick time off, including carryover of unused hours subject to the stated limit.
Additional paid time away may be requested for critical or emergency family issues.
Optional paid volunteer days.
Annual bonuses for non-sales roles, subject to Cisco policies.