Sparse Linear Algebra Libraries Intern - Summer 2027
About The Position
NVIDIA is seeking software engineering interns for its Sparse Linear Algebra team. This team develops libraries like cuSPARSE, which are crucial components of high-performance computing and deep learning software stacks. The primary goal of these libraries is to offer the fastest computing primitives for operations such as sparse matrix-vector and sparse matrix-matrix products. There is significant interest from various industrial and research sectors in optimizing these key functionalities for applications ranging from gaming and machine learning to autonomous driving and chip modeling. Optimizing these operations for current and future GPUs and for a wide array of unstructured sparse matrix inputs is essential, which may involve mathematical algorithm changes and the use of techniques like code/kernel generation. This internship offers an opportunity to be at the forefront of these projects, applying knowledge to develop and optimize impactful algorithms.
Requirements
- Pursuing MS or PhD in Computational Science, Computer Science, Applied Mathematics, or equivalent program area.
- Strong C++ programming, debugging, performance analysis, and test design skills
- Experience implementing sparse linear algebra algorithms
- Parallel programming experience using CUDA and/or OpenMP
- Experience with domain-specific language design, code/kernel generation, and compiler optimizations
Nice To Haves
- Exposure to numerical methods, floating-point arithmetic and numerical error analysis
- Knowledge of GPU/CPU and network hardware architecture
- A scripting language, preferably Python
- Understanding of composability and fusions, compilers, and implementation of programming languages
- Familiarity with recent CUDA developments like cuTILE and Tile++
- Experience with sparse compilers (MLIR or TACO)
Responsibilities
- Prototype and develop numerical algorithms for high-performance sparse linear algebra libraries for GPUs
- Analyze the performance of GPU implementations and find opportunities for improvements
- Collaborate with team members to understand software use cases and requirements
Benefits
- Intern benefits
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
What This Job Offers
Job Type
Full-time
Career Level
Intern
