Senior DL Compiler Engineer -CUDA Tile

NVIDIA•Austin, WA

8d•$152,000 - $241,500

About The Position

NVIDIA is seeking software engineers for the CUDA Tile team. NVIDIA GPUs are central to advancements in deep learning, powering breakthroughs in generative AI, large language models, recommendation systems, speech recognition, and image classification. This role offers the opportunity to collaborate with a skilled team and make a significant impact across the deep learning community. The position involves working on CUDA Tile, a new tile-based programming model for NVIDIA GPUs, which was introduced with CUDA 13.1. Responsibilities include designing and implementing compiler transformations, developing MLIR-based dialects and lowering passes, and optimizing the performance of tile-based kernels for efficient execution on various NVIDIA GPU architectures. The scope encompasses defining public APIs, creating and implementing compiler and optimization techniques, performance optimization, and general software engineering tasks.

Requirements

Bachelors, Masters or Ph.D. in Computer Science, Computer Engineering or a related field (or equivalent experience).
3+ years of relevant work or research experience in compiler optimization, performance analysis and IR design.
Ability to work independently, define project goals and scope, and lead your own development effort.
Excellent C/C++ programming and software design skills, including debugging, performance analysis, and test design.
Strong interpersonal skills.
Ability to work in a dynamic product-oriented team.

Nice To Haves

Knowledge of CPU and/or GPU architecture.
CUDA or OpenCL programming experience.
Experience with MLIR, LLVM, XLA, TVM.
Experience with deep learning models and algorithms.

Responsibilities

Design and implement compiler transformations.
Develop MLIR-based dialects and lowering passes.
Optimize the performance of tile-based kernels for efficient execution across multiple generations of NVIDIA GPU architectures.
Define public APIs.
Craft and implement compiler and optimization techniques.
Performance optimization.
General software engineering work.