About The Position

ASRC Federal is seeking a Staff HPC Engineer to support ASRC Federal Technology Solution in Manhattan, Kansas, serving the USDA Animal and Plant Health Inspection Service (APHIS) Marketing and Regulatory Programs Information Technology Division. The role supports scientific computing and data analytics systems used by APHIS laboratories and other program areas for genomics, diagnostics, modeling, analytics, data sharing, and emergency outbreak response. The HPC Systems Engineer/Administrator administers, maintains, optimizes, and manages the lifecycle of a high-performance computing environment for scientific research. The role helps ensure the availability, security, and performance of compute, storage, networking, and authentication infrastructure, provides technical support to USDA APHIS researchers, and collaborates with facilities, networking, cybersecurity, and vendor teams. The environment includes Linux compute, login, management, and GPU nodes; Slurm; a multi-petabyte Lustre parallel file system; NVIDIA InfiniBand; GPU software; and high-performance data-transfer capabilities. The position also supports scientific software and development environments, identity and security services, performance engineering, operational documentation, maintenance, disaster recovery planning, and user support. Daily work includes monitoring system health, resolving infrastructure issues, deploying updates, optimizing workloads, installing software, developing automation, coordinating changes, and assisting researchers with scheduling and performance.

Requirements

  • Bachelor’s degree in computer science or a related field.
  • Strong computer science background with in-depth systems-level knowledge of operating systems and networking.
  • At least 5 years of demonstrated competency provisioning and configuring medium-sized Linux environments using tools such as RHEL Satellite, Ansible, or Base Commander.
  • Ability to use system configuration management tools such as Puppet or Ansible and revision control software such as CVS, SVN, or Git.
  • Superior scripting skills and attention to detail; proficiency in at least one of Python, Perl, or Bash.
  • Demonstrated troubleshooting skills in complex environments, including networks and dependent systems.
  • Excellent customer service skills and attention to detail while supporting hundreds of scientific users.
  • Excellent communication and people skills, and strong time-management and organizational skills.

Nice To Haves

  • Experience with Base Commander or other orchestration platforms.
  • Previous experience supporting HPC environments and complex scientific computing centers.
  • Familiarity with or proficiency in OpenMP and Message Passing Interface (MPI) programming.
  • Experience with Lustre and InfiniBand.
  • Experience with Slurm.

Responsibilities

  • Administer and maintain Linux HPC compute, login, management, and GPU nodes.
  • Manage Slurm configuration, partitions, queues, scheduling policies, and resource allocation.
  • Install, provision, upgrade, and manage the lifecycle of operating systems.
  • Develop and maintain automation using Ansible, shell scripting, NVIDIA Base Command Manager, and other administrative tools.
  • Monitor cluster health, capacity, utilization, and performance.
  • Administer and optimize the HPE E1000 Lustre parallel file system.
  • Manage storage quotas, project directories, tiering policies, data placement, and storage capacity monitoring.
  • Troubleshoot Lustre performance, metadata operations, changelog processing, and client connectivity.
  • Administer and troubleshoot NVIDIA InfiniBand fabrics, including Subnet Manager, routing, and multi-rail configurations.
  • Maintain NVIDIA Base Command Manager and Cumulus Linux infrastructure.
  • Optimize MPI, UCX, NCCL, and RDMA communications for distributed scientific workloads.
  • Support Internet2 connectivity and high-performance data transfers using Globus Data Transfer Nodes.
  • Support NVIDIA GPU compute nodes and install, configure, and maintain CUDA, NCCL, GPU drivers, and related scientific software.
  • Benchmark and validate GPU performance following infrastructure changes.
  • Install, configure, and maintain scientific software packages and development environments.
  • Build and install software from source using Make, CMake, Ninja, and other build systems.
  • Configure and troubleshoot software compilation, compiler toolchains, library dependencies, compatibility, and linkage issues.
  • Develop and maintain environment modules for multiple software versions.
  • Support Conda, R, Apptainer, compilers, MPI implementations, CUDA toolkits, and GPU-enabled applications and containers.
  • Assist researchers with software deployment, optimization, troubleshooting, job scheduling, and software execution.
  • Administer authentication and authorization services, including Active Directory integration, LDAP, SSSD, Kerberos, and single sign-on technologies.
  • Coordinate operating-system patching and security updates; support vulnerability remediation and infrastructure hardening.
  • Maintain least-privilege access controls and security best practices.
  • Evaluate system performance using industry-standard benchmarks and analyze CPU, GPU, memory, storage, and network bottlenecks.
  • Optimize NUMA configuration, processor affinity, MPI communication, and storage performance for scientific workloads.
  • Validate infrastructure performance after hardware or software changes.
  • Develop and maintain standard operating procedures, technical documentation, and knowledge-base articles.
  • Participate in change management, coordinate maintenance and production changes, and maintain operational documentation.
  • Support disaster recovery planning, backup strategies, and infrastructure lifecycle planning.
  • Provide advanced technical support to researchers and scientific staff.
  • Collaborate with networking, storage, cybersecurity, and vendor teams to resolve complex technical issues.
  • Mentor junior technical staff through knowledge transfer, collaborative troubleshooting, and hands-on training.
  • Participate in procurement planning, hardware evaluations, and technology modernization initiatives.
  • Monitor cluster alerts, deploy system updates, develop operational automation, and work with vendors to diagnose hardware and software issues.
© 2026 Teal Labs, Inc
Privacy PolicyTerms of Service