Principal Platform Engineer – Kubernetes Reliability and Distributed Systems

Hewlett Packard Enterprise•Durham, NC
•$157,000 - $361,000•Hybrid

About The Position

Hewlett Packard Enterprise is seeking a Principal Platform Engineer to evolve and operate its Object Storage platform. The role focuses on Kubernetes, distributed systems, and highly available infrastructure, with ownership of complex platform-level challenges such as scheduling and resource management, pod failover, service discovery and load balancing, control-plane availability, node recovery, timeout behavior, and resilience in degraded conditions. This is a hands-on technical leadership role. The engineer will work across teams to establish technical ownership, diagnose complex production issues, guide architecture, and build scalable and reliable platform capabilities. The position is hybrid and requires working an average of two days per week from an HPE office. The role includes setting technical direction and standards, leading cross-team platform improvements, and guiding incident response and root-cause work. The principal engineer is expected to remain hands-on in debugging, prototyping, code review, and design validation while mentoring senior engineers and influencing organizational engineering practices.

Requirements

  • Significant experience designing, building, and operating production Kubernetes platforms.
  • Deep understanding of Kubernetes architecture and core components, including API server and control-plane services; scheduler and controller manager; nodes, kubelet, and container runtimes; services, endpoints, ingress, and load balancing; resource requests and limits; Quality of Service classes; affinity, anti-affinity, taints, tolerations, and topology constraints; pod disruption budgets and workload availability; and kubelet and CRI (containerd).
  • Strong knowledge of high-availability and failure-recovery patterns for distributed systems.
  • Demonstrated experience troubleshooting complex production failures involving Kubernetes, networking, infrastructure, and application services.
  • Experience diagnosing Kubernetes failover behavior, service timeouts, partial failures, network partitions, and degraded cluster states.
  • Experience with Kubernetes cluster upgrades.
  • Strong understanding of Linux systems, networking, DNS, TCP/IP, containers, and storage fundamentals.
  • Experience with cloud or on-premises infrastructure and infrastructure-as-code practices.
  • Proficiency in Go, Python, and Bash programming or scripting.
  • Experience developing automation, platform tooling, or operational frameworks.
  • Strong observability and reliability engineering experience using metrics, logs, traces, alerting, and performance analysis.
  • Demonstrated ability to lead complex technical initiatives across organizational boundaries.
  • Excellent written and verbal communication skills, including explaining complex technical issues to technical and non-technical stakeholders.
  • Ability to operate effectively during high-severity incidents and drive issues through root cause and permanent resolution.
  • Ability to establish technical direction, influence without direct authority, and mentor senior engineers.

Nice To Haves

  • Experience contributing to or extending Kubernetes, container-runtime, networking, or infrastructure projects.
  • Experience with Kubernetes distributions such as EKS, AKS, GKE, OpenShift, or upstream Kubernetes.
  • Experience with service meshes, ingress controllers, CNI plugins, CSI storage systems, or cluster-autoscaling technologies.
  • Experience with distributed databases, consensus systems, or control-plane technologies such as etcd.
  • Experience designing multi-cluster, multi-region, or edge-oriented Kubernetes environments.
  • Knowledge of Linux performance analysis, kernel behavior, and container isolation.
  • Experience with chaos engineering, failure injection, load testing, and resilience testing.
  • Experience establishing SLOs, error budgets, production-readiness reviews, and reliability governance.
  • Experience in environments with embedded, edge, fleet, or geographically distributed systems.
  • Familiarity with GitOps and deployment technologies such as Argo CD, Flux, Helm, or similar tools.
  • Relevant Kubernetes or cloud certifications, such as CKA or CKAD, or equivalent practical experience.

Responsibilities

  • Serve as the senior technical authority for Kubernetes platform architecture, reliability, and operational behavior.
  • Investigate and resolve complex issues involving pod failover and rescheduling; service availability and load balancing; control-plane and node failover; network, API, and service timeouts; resource allocation and scheduling; cluster capacity, performance, and scaling; and distributed-system failure and recovery behavior.
  • Define and drive improvements to Kubernetes high availability, fault tolerance, and disaster-recovery strategies.
  • Establish clear technical ownership and operating models for platform capabilities.
  • Lead architecture, design, and implementation of platform improvements across multiple engineering teams.
  • Develop repeatable approaches for diagnosing failures across application, Kubernetes, networking, storage, and infrastructure layers.
  • Improve platform observability through metrics, logs, traces, alerts, dashboards, and health indicators.
  • Define and monitor service-level objectives and reliability measures for platform components.
  • Lead or support major incident response, root-cause analysis, and corrective-action programs; identify systemic issues rather than treating incidents as isolated events.
  • Create technical standards, reference architectures, runbooks, and operational best practices.
  • Mentor senior engineers and raise organizational expertise in Kubernetes and distributed systems.
  • Partner with application, infrastructure, networking, security, and operations teams to resolve cross-functional issues.
  • Evaluate Kubernetes capabilities and platform technologies for their potential value.
  • Balance short-term incident resolution with long-term architectural improvements.
  • Own problems that cross team and technology boundaries and make architecture decisions affecting the broader platform and product roadmap.
  • Drive ambiguous, high-impact issues from symptoms through root cause and permanent resolution; create reusable platform capabilities and engineering standards; and influence without direct authority.
  • Remain hands-on by debugging systems, prototyping solutions, reviewing code, and validating designs.

Benefits

  • Comprehensive benefits supporting physical, financial, and emotional wellbeing.
  • Programs supporting personal and professional development and career goals.
  • Variable incentives may be offered in addition to base salary.
© 2026 Teal Labs, Inc
Privacy PolicyTerms of Service