Kubernetes Platform Engineer

Oak Ridge National Laboratory•Oak Ridge, TN

2d•Onsite

About The Position

The National Center for Computational Sciences (NCCS) at Oak Ridge National Lab (ORNL) is seeking highly qualified individuals to play a key role in improving the security, performance, and reliability of the NCCS computing infrastructure. This infrastructure supports multiple highly ranked Top500 Supercomputers, including the world’s first exaflop system, Frontier. As a Kubernetes Engineer for the Platform team, you will work within the Platforms group to support all activities of our supercomputer center. Our primary platform is the OLCF Slate Service, built on Kubernetes and Red Hat OpenShift, which provides a container orchestration service for running critical operation applications and user-managed persistent applications that run alongside our OLCF Supercomputer systems and other OLCF managed HPC clusters. As a Platform Engineer, you will operate, implement, and maintain the infrastructure underpinning our on-premises Kubernetes clusters, with a strong focus on scalability, reliability, and maintainability. You will assist with our platform engineering initiatives, evaluate and integrate key technologies, be an individual contributor for large and medium sized projects, and assist a team of engineers in delivering a robust internal platform that powers development across the organization.

Requirements

Kubernetes experience
Kubernetes cluster admin experience
Linux Sysadmin experience
Knowledge of data center hardware
Significant experience scripting and automation
BS degree in computer science, engineering or a scientific field
At least one year of experience with Kubernetes cluster administration
At least one year of experience with Linux system administration
Knowledge of data center hardware and infrastructure management (IPMI, OpenManage, etc.)
Experience with Infrastructure-as-Code tooling such as Terraform, Helm, and Puppet
Experience with CI/CD tooling and GitOps
Experience with code review and familiarity with tools like git, GitHub and GitLab

Nice To Haves

MS degree in Computer Science is preferred
Experience working in a national laboratory as an intern or staff member
Excellent interpersonal/communications skills, and the ability to work as part of a team
Experiencing with managing image registries such as Quay or Harbor
Solid understanding of networked computing environment concepts
Strong working knowledge of Unix systems fundamentals and common network protocols
Ability to develop and maintain programs and scripts that aid in the operation and automation of tasks using various shell and scripting languages (primarily bash, Python, and Go)
Ability to identify requirements and to define, plan, and implement requisite solutions
Experience using tools such as Prometheus, Nagios, and Grafana to monitor systems, metrics and create dashboards
Experience designing and implementing highly-available systems/services
Experience with Site Reliability Engineering for Kubernetes infrastructure and application deployments

Responsibilities

Assist in day to day operations for on-premises and cloud-based Kubernetes clusters
Develop and integrate critical components for networking, CI/CD tooling, OS management, service mesh, and Kubernetes operators—excluding observability, which is handled by a dedicated SRE sub-team.
Help build test environments to evaluate tooling based on performance, feature set, and maintainability—especially for components that must work reliably with on-premise hardware and OS requirements.
Assist staff on upgrades, security hardening, monitoring integration, and scalability of all cluster infrastructure.
Participant in an on-call rotation.
Write and maintain infrastructure and deployment code using tools such as ArgoCD (GitOps), Puppet (OS management), Go, Python, Bash, and GitLab CI.
Support the use and understanding of in-house Kubernetes operators and serve as a secondary maintainer for those controllers.
Write and maintain automation for infrastructure provisioning and Kubernetes cluster lifecycle management – most of our K8s clusters run on bare metal
Write and maintain automation for configuration of host OS and Kubernetes tooling
Understand the principles of enterprise data centers and hardware management
Partner closely with internal cybersecurity and development teams to ensure the platform meets security, compliance, and usability expectations.
Participate in cross-functional projects related to platform enhancements and cluster lifecycle automation.
Be able to represent the Platforms team with vendors and both internal collaborators and partners.