Site Reliable Engineer (US - Remote)

AXON-Networks•Irvine, CA

1d•$160,000 - $200,000•Remote

About The Position

The Site Reliability Engineer will improve the availability, performance, scalability and recoverability of AXON Networks cloud solutions. You will combine software engineering with hands-on NOC operations to make the complete cloud-to-device service path observable, supportable and resilient at fleet scale. You will help establish practical SRE capabilities inside the NOC while partnering closely with Support, Operations, cloud and DevOps Engineering. You will participate in a sustainable on-call rotation and improve the NOC’s ability to diagnose customer-impacting issues.

Requirements

5+ years of experience in site reliability engineering, production engineering, DevOps, cloud infrastructure, systems engineering or a closely related role.
Strong software or automation skills in Python, Go, Java, Bash or a comparable language, with experience producing maintainable operational code.
Hands-on experience operating distributed production systems in a public cloud environment and troubleshooting across application, infrastructure, network and device-integration layers.
Experience with Google Cloud Platform, Oracle Cloud Infrastructure and production Kubernetes environments.
Experience with infrastructure as code and delivery tooling such as Terraform, Helm, Git-based CI/CD and policy-as-code.
Strong Linux, containers and Kubernetes fundamentals, including deployment behavior, resource management, networking and failure diagnosis.
Strong troubleshooting & debugging skills in Kubernetes platforms.
Experience with modern observability practices and tools across metrics, logs, traces, alerting, dashboards and synthetic monitoring.
Familiarity with Prometheus, Grafana, OpenTelemetry or equivalent observability ecosystems.
Familiarity with Apache Pulsar or similar distributed messaging and streaming platforms handling requests from millions of devices.
Experience participating in an on-call rotation and responding effectively to high-severity, customer-impacting production incidents.
Working knowledge of SLOs, error budgets, capacity planning, resilience engineering, change safety and blameless incident learning.
Strong networking knowledge, including TCP/IP, DNS, DHCP, TLS, routing, NAT, load balancing and systematic packet- or session-level troubleshooting.
Clear communication, disciplined documentation and the ability to collaborate across NOC, cloud, DevOps, firmware and service-provider teams.
Bachelor’s degree in computer science, engineering or equivalent practical experience.

Nice To Haves

Experience supporting cloud-managed CPEs such as broadband gateways, routers, ONTs, Wi-Fi/mesh systems or similar edge devices in a service-provider environment.
Familiarity with TR-069/CWMP, TR-369/USP, TR-181 data models, ACS or USP controller platforms, device telemetry and remote lifecycle management.
Experience supporting messaging and streaming platforms such as Apache Pulsar or Kafka, APIs and highly available databases used in device-management control planes.
Understanding of access technologies such as GPON/XGS-PON, DOCSIS, Ethernet or fixed wireless and how CPE, ONTs and provider networks interact.
Experience with firmware rollout automation, canary or cohort deployments, fleet health analysis and safe rollback practices.
Experience building auto-remediation, safe self-service operations or internal reliability platforms.
Experience supporting multiple service-provider customers in a 24×7 telecommunications, broadband or managed-network environment.

Responsibilities

Own reliability outcomes for assigned cloud services
Improve observability, capacity, resilience and recovery
Define and operationalize service-level indicators, service-level objectives and actionable alerting.
Automate repetitive NOC work and create safe, testable mechanisms for diagnosis, recovery, device operations and routine production changes.
Lead technically during incidents, drive evidence-based learning and ensure high-value corrective actions are completed.
Establish reliability baselines, SLIs, SLOs and error budgets for cloud services and critical device-management workflows such as onboarding, provisioning, configuration, telemetry collection, command execution and firmware delivery.
Trace failures across the end-to-end service path: cloud APIs and microservices, Kubernetes and infrastructure, databases and messaging, internet and access-network dependencies, device-management protocols and the devices
Identify fleet-wide and customer-specific failure patterns involving device reachability, session stability, configuration drift, command latency, telemetry gaps, firmware behavior and cloud capacity.
Contribute operability requirements and production evidence during design and readiness reviews
Maintain NOC dashboards for service health, device reachability, provisioning success, command and telemetry performance, firmware adoption and customer impact.
Participate in the NOC production on-call rotation and serve as a technical incident lead or senior troubleshooter when appropriate.
Diagnose complex failures across applications, cloud infrastructure, Kubernetes, APIs, networking, DNS/TLS, databases, messaging platforms, device-management sessions and CPE behavior.
Coordinate evidence gathering and technical escalation with service-provider customers, Engineering, firmware, DevOps and vendors while maintaining clear mitigation, recovery and handoff.
Lead or contribute to post-incident reviews; convert recurring device, platform and process failures into prioritized and measurable corrective actions.
Develop production-grade software, scripts and workflows for diagnosis, remediation, deployment safety, fleet analysis, scaling, maintenance and recovery.
Improve CI/CD and GitOps practices for operational software and infrastructure, including automated testing, release validation, progressive delivery and rollback readiness.
Manage or contribute to infrastructure as code, configuration as code and reusable self-service patterns for cloud and NOC operations.
Measure NOC toil and partner with Automation & Tools Engineers to prioritize durable platform capabilities instead of fragmented one-off scripts.
Develop capacity models for service-provider growth, managed-device populations, telemetry volume, messaging throughput, API demand and rollout events.
Create and maintain runbooks, troubleshooting decision trees, service maps, device and cloud dependency records, known-error guidance and operational knowledge.
Coach NOC and Support personnel on diagnosis, safe mitigation, evidence capture and escalation across cloud, network and CPE layers.
Build self-service diagnostic views and tools that help the NOC determine scope, affected customers, device cohorts, likely fault domain and next action.
Share reliability insights with Engineering and Product and contribute to reliability reviews, operational-readiness reviews and continuous-improvement priorities.