Principal Site Reliability Engineer

Green Dot•Los Angeles, CA
•Hybrid

About The Position

Green Dot is seeking a Principal Site Reliability Engineer to serve as the senior technical leader for reliability, release management, and database operations across its cloud and hybrid platforms. This hands-on individual-contributor role will set strategy and standards for building, deploying, observing, and recovering services, while ensuring the data tier is highly available, performant, and resilient. The role requires deep software and systems engineering expertise, sound judgment in a regulated environment, and the ability to influence engineering teams across the organization. The position focuses on critical payment and banking services and includes ownership of the end-to-end release process, from code merge through production. The engineer will lead reliability strategy, observability, incident response, resilience and disaster-recovery practices, enterprise release management, CI/CD and GitOps, and database reliability for technologies including SQL Server, Azure SQL, Cosmos DB, and related data stores. This is a structured hybrid position, with an expectation of three days per week in the office and flexibility to work remotely on the remaining days. The role is open only to candidates who currently reside in West Los Angeles, California. On-site expectations may change to support business needs, with advance communication. The position is regular, and the targeted base salary is $129,000 to $193,400 per year; final compensation depends on qualifications, expertise, and geographic location. Green Dot does not offer visa sponsorship; applicants must be authorized to work in the United States without current or future sponsorship.

Requirements

  • Bachelor's degree in Computer Science, Engineering, or a related field, or equivalent experience.
  • 10 or more years of experience in Site Reliability Engineering, DevOps, Release Engineering, or Infrastructure Engineering, with a record of operating complex, highly available production systems.
  • At least 5 years of hands-on experience leading release management or CI/CD for multiple teams or services.
  • At least 5 years of hands-on database experience with Microsoft SQL Server and/or Azure SQL, plus hands-on Azure Cosmos DB experience, including high availability/disaster recovery, performance tuning, and production troubleshooting.
  • Deep expertise in Azure and working knowledge of AWS.
  • Production experience with Kubernetes (AKS/EKS), Docker, and Helm.
  • Strong proficiency in Infrastructure as Code and GitOps, including Terraform; Ansible and Argo CD or similar are also specified.
  • Expertise with Azure DevOps pipelines, GitHub Actions, and Git-based workflows.
  • Expert-level observability experience with Datadog or comparable platforms, including logging, APM, metrics, and alerting.
  • Strong scripting and automation skills in PowerShell, Python, and Bash, and strong T-SQL skills.
  • Experience with messaging and event bus technologies such as Azure Service Bus, RabbitMQ, or similar.
  • Experience running incident response, root-cause analyses, and on-call programs.
  • Strong communication skills and ability to explain complex technical topics to engineers and executives.
  • Ability to work in the United States without sponsorship, now or in the future.
  • Must currently reside in West Los Angeles, California.

Nice To Haves

  • Experience in financial services, banking, payments, or fintech, including work under PCI DSS, SOX, or similar regulatory controls.
  • Experience with progressive delivery or feature-flag platforms.
  • Experience with Redis caching and PostgreSQL.
  • Familiarity with service mesh technologies such as Istio or Linkerd and Kubernetes security best practices.
  • Experience with .NET application environments, Windows Server/IIS, and Linux.
  • Certifications such as Azure Solutions Architect Expert, Azure DevOps Engineer Expert, Microsoft Certified: Azure Database Administrator Associate, CKA/CKAD, AWS Solutions Architect, or ITIL.

Responsibilities

  • Define and drive SRE strategy, standards, and roadmap for availability, latency, scalability, and resilience across critical payment and banking services.
  • Establish and govern SLIs, SLOs, and error budgets with product and engineering stakeholders, and regularly report reliability KPIs to leadership.
  • Architect and maintain highly available, fault-tolerant infrastructure across Azure and AWS, including multi-region and disaster-recovery designs.
  • Govern and improve observability for logging, metrics, tracing, and alerting, using Datadog as the primary tool alongside Prometheus/Grafana and native cloud monitoring.
  • Lead incident management, serve as Incident Commander for high-severity events, conduct blameless post-incident reviews, and track corrective actions to completion.
  • Participate in and improve on-call rotations, runbooks, alert quality, and escalation paths.
  • Ensure messaging and event-driven systems process messages efficiently, and monitor lag, dead-lettering, and throughput.
  • Lead capacity planning, performance testing, and cloud cost optimization; reduce toil through automation and self-service tooling.
  • Run chaos engineering, resilience testing, and disaster-recovery/business-continuity exercises to validate RTO/RPO targets.
  • Own enterprise release management, including release planning, scheduling, calendars, change windows, and go/no-go decisions.
  • Design and implement automated deployment strategies, including blue/green, canary, rolling, and feature-flag deployments across development, QA, UAT, staging, and production environments.
  • Architect, standardize, and maintain CI/CD pipelines with automated testing, security scanning, and quality gates.
  • Drive GitOps practices so infrastructure and application deployments are declarative, version-controlled, and auditable.
  • Participate in the Change Advisory Board and lead change management, ensuring releases have approvals, evidence, and audit trails appropriate to regulated environments.
  • Define branching, versioning, and environment-promotion strategies, and oversee rollback and hotfix procedures.
  • Coordinate cross-team releases with Development, QA, Product, Security, and Operations; communicate release status, risks, and outcomes to stakeholders.
  • Track and improve DORA metrics, including deployment frequency, lead time for changes, change failure rate, and mean time to restore.
  • Maintain release documentation, release notes, and post-release reviews in Jira and Confluence.
  • Lead reliability for the data tier, including Microsoft SQL Server, Azure SQL Database/Managed Instance, Cosmos DB, PostgreSQL, and Redis.
  • Design and maintain database high-availability and disaster-recovery solutions, including Always On Availability Groups, failover clustering, geo-replication, and tested backup and restore procedures.
  • Lead database change management within CI/CD using automated, version-controlled schema migrations and safe rollback paths.
  • Tune database performance through query optimization, indexing strategy, execution-plan analysis, blocking/deadlock resolution, Cosmos DB partitioning and RU/s capacity management, and capacity forecasting.
  • Build database observability and proactive alerts for replication lag, resource pressure, and long-running queries.
  • Partner with Information Security on database controls, including encryption at rest and in transit, least-privilege access, auditing, and patching.
  • Automate routine database administration tasks such as maintenance, patching, health checks, and provisioning using scripting and infrastructure-as-code tools.
  • Serve as a technical authority and mentor to SRE, DevOps, and release engineers, fostering continuous learning and operational excellence.
  • Influence architecture decisions so services are designed for reliability, observability, and deployability from the outset.
  • Partner with Security, Compliance, and Audit teams to support control requirements and audits with evidence.
  • Evaluate emerging tools and practices, and lead their adoption when they provide measurable value.
© 2026 Teal Labs, Inc
Privacy PolicyTerms of Service