Senior Site Reliability Engineer - Storage

NVIDIA•Us, CA

About The Position

NVIDIA is a leader in AI, High-Performance Computing, and Visualization. The GPU, our invention, is central to our products and services, driving innovation in areas like artificial intelligence and autonomous cars. We are seeking a Senior Site Reliability Engineer focused on HPC storage to join our team. This role involves designing, implementing, and optimizing on-prem High-Performance Computing (HPC) storage solutions, integrating cloud computing capabilities. You will be responsible for creating and deploying distributed storage solutions, building automation tools, and ensuring the efficient operation of our IT ecosystem. Collaboration with engineering teams to align infrastructure with their needs, documenting best practices, and contributing to groundbreaking projects are key aspects of this position.

Requirements

BS in Computer Science (or equivalent experience) with 8+ years of relevant experience, MS with 5+ years of experience or Ph.D. with 3 years of experience.
8+ years of experience crafting technology solutions and resolving performance bottlenecks for HPC applications.
Design, deployment and management of Enterprise NAS solutions like NetApp, Pure Storage and S3 based storage such as cloudian MinIO.
Design, deployment, and management of Enterprise NAS solutions like NetApp, Pure Storage, and S3-based storage such as Cloudian MinIO.
Experience with one or more parallel or distributed filesystems such as Lustre, GPFS.
Python/Bash/Golang programming/scripting experience.
Strong Experience operating services in any of the leading Cloud environment [ AWS, Azure or GCP].
Experience with multiple monitoring stacks such as Prometheus+Grafana, Elasticsearch+Kibana, Splunk, Zabbix, etc.
Familiarity with newer and emerging monitoring products.
Excellent communication and collaboration skills.

Nice To Haves

Background with RDMA (InfiniBand or RoCE) fabrics.
Prior Experience with HPC cluster management tools such as Slurm, PBS, LSF, etc.
Experience with containerization technologies, such as Docker, Mesosphere DCOS, Kubernetes (k8s).

Responsibilities

Design, implement an on-prem HPC infrastructure supplemented with cloud computing to support the growing IT needs of NVIDIA.
Design and implement scalable and efficient Storage solutions tailored for data-intensive applications, optimizing performance and cost-effectiveness.
Develop tooling to automate deployment and management of large-scale infrastructure environments, to automate operational monitoring and alerting, and to enable self-service consumption of resources.
Document the general procedures and practices, perform technology evaluations, related to distributed file systems.
Collaborate across teams to better understand developers' workflows and gather their infrastructure requirements.
Influence and guide methodologies for building, testing, and deploying applications to ensure optimal performance and resource utilization.