Staff Site Reliability Engineer

Grubhub•New York, NY

About The Position

This role is crucial for simplifying the dining experience for students across the US. You will be instrumental in architecting resilient and self-healing solutions, managing AWS infrastructure, closing observability gaps, designing scaling approaches, and shaping incident management processes. Your contributions will span the entire development lifecycle, encompassing the building and maintenance of CI/CD pipelines. Your role will be pivotal in ensuring the platform's scalability to support Grubhub's continuously expanding customer base, evidenced by the addition of 30 new campuses and a 25% year-over-year increase in order volume.

Requirements

Demonstrated Staff-level scope: has owned a production platform end to end, driven technical direction across teams without formal authority, and led both incident response and architecture review.
Typically 8+ years in SRE, DevOps or infrastructure engineering, though scope and impact weigh more than tenure.
Deep experience with Infrastructure as Code - Terraform (with Terraspace or a similar wrapper) - owning modules, state and rollout across multiple environments.
Kubernetes at operator depth: EKS lifecycle, Helm and Helmfile, controllers and add-ons, ingress/gateway, and autoscaling (HPA/KEDA).
Multi-region AWS architecture, including failover design and the data-layer replication it depends on.
Deep knowledge of CI/CD tools (e.g., Jenkins, GitHub Actions).
Software engineering experience in Python, Go, or a similar object-oriented language.
Proficiency with datastores (MySQL, MongoDB/Atlas, Redis/ElastiCache) and message brokers (RabbitMQ/AmazonMQ, SQS).
Experience with Microservice Architecture and Application Design.
Distributed monitoring experience, including SLOs, metrics, tracing and log pipelines.
Strong working knowledge of cloud fundamentals (AWS compute/containers, storage, Linux, networking).
Comfort operating in compliance-scoped environments (PCI or equivalent).
Strong technical writing, documentation, and communication skills.
Experience with highly trafficked web-based services.
Ability to set technical direction and build consensus across engineering teams in multiple time zones.

Responsibilities

Architect resilient, self-healing systems and co-own the design of critical production services.
Own multi-region resilience: active-standby architecture, regional failover readiness, runbooks and drills, RTO/RPO targets, and the data-layer replication behind them (ElastiCache Global Datastore, MongoDB/Atlas, RDS).
Own AWS infrastructure as code - Terraform/Terraspace, Helm and Helmfile - from design through rollout.
Own the Kubernetes platform: EKS lifecycle, controller and add-on upgrades, ingress/gateway, and autoscaling (HPA/KEDA).
Own the observability platform end to end - logging, metrics, tracing and alerting pipelines - including its signal quality and its cost.
Drive reliability improvements using SLOs and telemetry data, closing observability gaps before they turn into incidents.
Design scaling and capacity strategy against a strongly seasonal traffic profile that peaks at back-to-school.
Own cloud cost accountability for the platform: right-sizing, reservations, and tracking realized savings.
Build and maintain CI/CD pipelines and the deployment tooling the team depends on.
Operate within PCI-scoped environments, respecting segregated clusters and access paths.
Shape incident management: lead incident response, postmortems, failure analysis, service reviews and architecture review.