Senior GPU Kernel Performance Lead

NVIDIA • Us, CA

13d

About The Position

We're now looking for a Senior GPU Kernel Performance Lead. Do you enjoy analyzing and reporting on GPU kernel performance? If so, consider applying for the role of Senior GPU Kernel Performance Analysis Lead! Our team delivers high-performance GPU math kernels to NVIDIA’s cuDNN , cuBLAS , and TensorRT libraries to accelerate deep learning models. The team is proud to play an integral part in enabling breakthroughs in domains such as image classification, speech recognition, natural language processing,and large language models. We’re always striving for peak performance and energy efficiency on current and future-generation GPUs. As a kernel performance analysis lead, you will oversee all efforts pertaining to the performance of our kernels. Join the team that is building the underlying software used across the world to power the revolution in artificial intelligence! To get a sense of the code we write, check out our CUTLASS open-source project showcasing performant matrix multiply on NVIDIA’s Tensor Cores with CUDA. While there will be the opportunity for hands-on development, this position specifically is to lead a team for validating the performance of the kernels.

Requirements

• PhD degree in Computer Science, Computer Engineering, Applied Math, or related field (or equivalent experience) with 8+ years of relevant industry experience.
• Demonstrated strong C++ programming and software design skills, including debugging, performance analysis, and test design
• Experience leading or managing a team relating to the performance of CPUs, GPUs, or other DL accelerators

Nice To Haves

• Experience with analytical models and cycle-accurate HW simulators
• Knowledgeable about performance tools like Nsight or VTune
• Programming experience beyond C++ including assembly, MLIR/LLVM, Python, and CUDA/OpenCL

Responsibilities

• Specify test cases, derived from Deep Learning workloads, to provide adequate directed and use-case coverage across all kernels on both simulation and silicon targets
• Determine performance theory through the development and use of analytical models
• Track and report on kernel performance throughout the development lifecycle by using and expanding upon current infrastructure
• Provide feedback to the kernel developers by identifying performance regressions and opportunities to reach the achievable peak performance

Benefits

• Your base salary will be determined based on your location, experience, and the pay of employees in similar positions.
• The base salary range is 224,000 USD - 356,500 USD for Level 5, and 272,000 USD - 425,500 USD for Level 6.
• You will also be eligible for equity and benefits .
• NVIDIA is committed to fostering a diverse work environment and proud to be an equal opportunity employer.
• As we highly value diversity in our current and future employees, we do not discriminate (including in our hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.

What This Job Offers

• Job Type: Full-time
• Career Level: Mid Level
• Education Level: Ph.D. or professional degree
• Number of Employees: 5,001-10,000 employees