Principal Reliability Engineer

Enlyte
$133,000 - $190,000Remote

About The Position

This is a full-time remote position that can be located anywhere in the U.S. The Principal Reliability Engineer is a senior technical leader responsible for the reliability, observability, and operational control of enterprise platforms and services. This role owns the design and evolution of the reliability control plane, including visibility, telemetry, alerting, and integrations across monitoring, incident management, and automation tooling. At the Principal level, this role leads complex, high‑impact reliability initiatives, defines standards for observability and operational readiness, and partners closely with Cloud, Platform, Security, and Application teams to ensure systems are resilient, measurable, and operable at scale.

Requirements

  • 12+ years of related experience with a Bachelor’s degree; or equivalent professional experience.
  • Extensive experience designing and operating reliable, observable systems at scale.
  • Proven success owning or leading observability and incident management platforms.
  • Background in cloud, platform, or infrastructure engineering strongly preferred.
  • Deep expertise in reliability engineering, observability, and distributed systems.
  • Strong understanding of monitoring, logging, tracing, alerting, and incident management concepts.
  • Experience integrating and operating reliability tooling at enterprise scale.
  • Solid grasp of cloud and platform architectures and their operational characteristics.
  • Ability to translate operational risk and system behavior into actionable engineering improvements.

Responsibilities

  • Own the reliability control plane, including standards and architecture for monitoring, logging, tracing, alerting, and incident management.
  • Define how services expose health, performance, and operational signals across the enterprise.
  • Establish and evolve reliability patterns and reference architectures adopted across teams.
  • Lead design decisions that improve system resilience, fault tolerance, and recoverability.
  • Own integrations between platforms and reliability tooling (monitoring, alerting, incident response, on-call, and automation systems).
  • Define consistent approaches to telemetry collection, normalization, and consumption.
  • Ensure observability tooling provides actionable visibility aligned to service-level objectives.
  • Evaluate and recommend tooling improvements that enhance visibility and operational insight.
  • Lead complex reliability initiatives impacting multiple systems or platforms.
  • Partner with engineering teams to design reliable, observable services from inception.
  • Drive adoption of best practices for operational readiness, graceful degradation, and failure handling.
  • Review system designs to ensure reliability and observability requirements are met.
  • Establish standards for alerting quality, escalation, and incident response.
  • Drive improvements in incident detection, diagnosis, and recovery.
  • Lead or support root cause analysis for significant incidents and ensure durable corrective actions.
  • Promote a culture of operational excellence and continuous reliability improvement.
  • Serve as a technical leader and trusted advisor on reliability and observability.
  • Mentor senior engineers and influence reliability practices across teams.
  • Collaborate with Cloud, Security, and Platform leaders to align reliability strategy with business needs.

Benefits

  • We’re committed to supporting your ultimate well-being through our total compensation package offerings that support your health, wealth and self.
  • These offerings include Medical, Dental, Vision, Health Savings Accounts / Flexible Spending Accounts, Life and AD&D Insurance, 401(k), Tuition Reimbursement, and an array of resources that encourage a lifetime of healthier living.
  • Benefits eligibility may differ depending on full-time or part-time status.
  • Compensation depends on the applicable US geographic market.
  • The expected base pay for this position ranges from $133,000 - $190,000 annually, and will be based on a number of additional factors including skills, experience, and education.
  • The Company is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to race, religion, color, national origin, gender, gender identity, sexual orientation, age, status as a protected veteran, among other things, or status as a qualified individual with disability.
  • Don’t meet every single requirement? Studies have shown that women and underrepresented minorities are less likely to apply to jobs unless they meet every single qualification. We are dedicated to building a diverse, inclusive, and authentic workplace, so if you’re excited about this role but your past experience doesn’t align perfectly with every qualification in the job description, we encourage you to apply anyway. You may be just the right candidate for this or other roles.
© 2024 Teal Labs, Inc
Privacy PolicyTerms of Service