Senior HPC AI Cluster Engineer
About The Position
NVIDIA is seeking an experienced HPC-AI Engineer to join its Networking Clusters Solutions Infrastructure team, which builds supercomputers and AI clusters using advanced technologies. The engineer will contribute to computing hardware and software for artificial intelligence and GPU computing, provide insight into at-scale system design and tuning for large-scale compute runs, and work with accelerated computing and deep learning platforms. The role involves collaborating with scientific researchers, developers, customers, and HPC, OS, GPU-compute, and systems specialists to architect, develop, and bring up large-scale performance platforms.
Requirements
- A degree in Computer Science, Engineering, or a related field, or equivalent experience, and 8 or more years of experience.
- Knowledge of HPC and AI solution technologies, from CPUs and GPUs to high-speed interconnects and supporting software.
- Experience with job scheduling workloads and orchestration tools such as Slurm and Kubernetes.
- Excellent knowledge of Windows and Linux (Red Hat/CentOS and Ubuntu), networking and internals, ACLs, OS-level security protection, and common protocols such as TCP, DHCP, and DNS.
- Experience with multiple storage solutions such as Lustre, GPFS, and Weka.io; familiarity with newer and emerging storage technologies.
- Experience with Python programming and Bash scripting.
- Familiarity with automation and configuration management tools such as Jenkins, Ansible, and Puppet/Chef.
- Deep knowledge of networking protocols such as InfiniBand and Ethernet.
- Deep understanding of and experience with virtual systems such as VMware, Hyper-V, KVM, or Citrix.
- Familiarity with cloud computing platforms such as AWS, Azure, or Google Cloud.
Nice To Haves
- Knowledge of CPU and/or GPU architecture.
- Knowledge of Kubernetes and container-related microservice technologies.
- Experience with GPU-focused hardware and software such as DGX and CUDA.
- Experience with RDMA fabrics such as InfiniBand or RoCE.
Responsibilities
- Design, implement, and maintain large-scale HPC/AI clusters, including monitoring, logging, and alerting.
- Manage Linux job and workload schedulers and orchestration tools.
- Develop and maintain continuous integration and delivery pipelines.
- Develop tools to automate deployment and management of large-scale infrastructure, operational monitoring and alerting, and self-service resource consumption.
- Deploy monitoring solutions for servers, networks, and storage.
- Troubleshoot from bare metal through the operating system, software stack, and application level.
- Serve as a technical resource, develop and redefine standard methodologies, and document them for internal teams.
- Support research and development activities and participate in proofs of concept and proofs of value for future improvements.
Benefits
- Equity
- Benefits package
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
What This Job Offers
Job Type
Full-time
Career Level
Senior
