Observability Engineer

Harbor Freight • Calabasas, CA

1d

About The Position

The Observability Engineer designs, builds, implements, and administers tools and pipelines that provide full-stack visibility into infrastructure, applications, and business services. The role owns the day-to-day operation of the observability platforms and the Network/Technical Operations Center (NOC/TOC), supporting the stability, reliability, availability, and performance of business services. It develops observability that correlates metrics, logs, traces, and events into actionable insight, reducing time to detect and resolve issues.

The position provides observability expertise across networks and cloud networking; directory services; messaging and collaboration platforms; eCommerce and customer-facing digital environments; remote access and VPN infrastructure; wireless, mobile, and endpoint fleets; Windows and Linux; backup, storage, and disaster recovery; voice and unified communications; virtualized and containerized environments; public and hybrid cloud; and critical business services and transaction flows. It owns alert intake, triage, escalation, incident coordination, and post-incident reviews; defines monitoring standards and operational metrics; and develops dashboards, runbooks, and processes. The role also mentors technical and cross-functional teams, evaluates tools, supports capacity planning and fault prediction, integrates telemetry with automation and security operations, and partners with Help Desk, Infrastructure, DevOps/SRE, and Application teams.

After-hours work, shift work, and an on-call rotation are required. The role has no staff supervision responsibility. Travel is up to 5%, and the position is designated Anywhere. The anticipated salary range is $87,600–$131,500, depending on location, knowledge, skills, education, and experience; the position is also eligible for an annual discretionary bonus.

Requirements

• Availability for after-hours work, shift work, and an on-call rotation.

Responsibilities

• Design, deploy, and maintain observability platforms for metrics, logs, traces, synthetic monitoring, and real user monitoring.
• Own and operate the NOC/TOC function, including alert intake, triage, escalation, incident coordination, and post-incident review.
• Develop and maintain observability standards, naming conventions, and instrumentation guidelines across infrastructure and application teams.
• Build and tune alerting logic to reduce noise and alert fatigue and improve actionable, high-signal alerts.
• Define, track, and report on SLIs, SLOs, error budgets, and other observability and operational KPIs.
• Develop dashboards and visualizations that communicate service health to technical teams and business stakeholders.
• Mentor technical staff and cross-functional teams on observability concepts, instrumentation practices, and tools.
• Develop, document, and continuously improve monitoring and incident-response processes and runbooks.
• Troubleshoot issues in the monitoring and observability stack, including data gaps, false positives, and agent or collector health.
• Evaluate, pilot, and recommend observability tools and platforms.
• Partner with Help Desk, Infrastructure, DevOps/SRE, and Application teams to implement monitoring, alerting, and response processes.
• Manage the call notification, paging, and escalation system for alerts.
• Lead capacity planning, performance trending, and fault prediction using historical observability data.
• Integrate observability data with automation and AIOps workflows to enable auto-remediation where appropriate.
• Support security operations by feeding relevant telemetry into SIEM/SOC tooling and collaborating on anomaly detection.
• Provide expertise and develop observability solutions across network and cloud networking technologies, directory services, messaging and collaboration platforms, eCommerce and customer-facing environments, remote access and VPN, wireless/mobile/endpoints, operating systems, backup/storage/disaster recovery, voice and unified communications, virtualized and containerized environments, public and hybrid cloud, and critical business services and transaction flows.
• Review data and provide recommendations on alert actions, monitoring, and responses.

Benefits

• Medical insurance
• Dental insurance
• Vision insurance
• Life insurance
• Short-term disability
• Long-term disability
• 401(k) plan for eligible Associates
• Paid time off of up to 236 hours per year, inclusive of PTO, floating holidays, and paid holidays
• Paid sick time of up to 80 hours per year unless otherwise required by law
• Annual discretionary bonus eligibility

What This Job Offers

• Job Type: Full-time
• Education Level: No Education Listed