HPC Storage and Data Management Engineer

Cynet Systems • Greenville, SC

7d

About The Position

The HPC Storage and Data Management Engineer is an infrastructure specialist responsible for designing, administering, and optimizing storage environments within an enterprise-scale, AWS-based high-performance computing platform. The role is within ADT and works closely with the Digital Technology (DT) team on storage operations and data lifecycle management. It supports approximately 1,500 global users running engineering simulation workloads across Gas Power and broader business units.

The engineer manages HPC storage environments spanning home directories, high-performance local scratch and compute storage, project storage, and archive tiers. The role also establishes storage governance and lifecycle practices, supports capacity planning and cost reporting, and collaborates on standards for engineering simulation data retention, organization, and accessibility for AI/ML workloads.

Requirements

• Experience administering HPC storage in a production environment.
• Experience with quota management systems and storage capacity planning.
• Expertise in high-performance parallel or distributed file systems, such as Lustre, GPFS/IBM Spectrum Scale, BeeGFS, WekaIO, or similar.
• Proficiency in storage tiering, data lifecycle management, and archival tooling.
• Solid Linux systems administration skills.
• Strong experience managing NFS and SMB/CIFS permissions and ACLs.
• Experience in an AWS or cloud-hybrid storage environment, including S3, FSx for Lustre, or EFS.
• Experience working in a DevOps or collaborative Infrastructure as Code model.
• Ability to develop and document standard operating procedures.

Nice To Haves

• Familiarity with engineering simulation data, such as CFD or FEA, and associated file-size and storage patterns.
• Familiarity with the Slurm job scheduler in the context of scratch and burst storage.

Responsibilities

• Manage and optimize HPC storage topology across home directories, high-performance local scratch/compute, project storage, and archive tiers, aligning data placement with workload performance requirements.
• Administer and enforce per-user and per-project storage quotas, monitor utilization trends, and provide capacity-forecasting inputs to the HPC Principal Engineer and DT team.
• Manage file permissions and access control lists (ACLs) across NFS/SMB environments for Linux HPC and Windows VDI users.
• Contribute to storage cost benchmarking and reporting, providing data-driven insight into storage spending in AWS.
• Define and enforce data lifecycle policies for active, scratch, cold, and archive data states, and implement and maintain automated tiering and expiration workflows.
• Lead the definition and implementation of an engineering simulation data archival standard aligned with the broader engineering simulation data retention strategy.
• Partner with DT to define and maintain collaborative team and project folder structures, and establish and communicate standard work for shared HPC storage use.
• Support the development of engineering simulation data standards that ensure data is structured and accessible for AI/ML workloads.
• Develop and document standard operating procedures.

What This Job Offers

• Job Type: Full-time
• Education Level: No Education Listed