Senior DL Compiler Engineer - CUDA Tile LPU

NVIDIA•Austin, CA

About The Position

NVIDIA is transforming computer graphics, PC gaming, and accelerated computing, now tapping into the unlimited potential of AI to define the next era of computing. This role is within the CUDA Tile team, focusing on supporting CUDA Tile, a new tile-based programming model for NVIDIA LPUs, which shipped with CUDA 13.1. The position involves designing and implementing compiler transformations, developing MLIR-based dialects and lowering passes, and optimizing the performance of tile-based kernels for efficient execution across multiple generations of NVIDIA GPU and LPU architectures. The scope includes defining public APIs, crafting and implementing compiler and optimization techniques, performance optimization, and general software engineering.

Requirements

Bachelors, Masters or Ph.D. in Computer Science, Computer Engineering or a related field (or equivalent experience)
3+ years of relevant work or research experience in compiler optimization, performance analysis and IR design.
Ability to work independently, define project goals and scope, and lead your own development effort.
Excellent C/C++ programming and software design skills, including debugging, performance analysis, and test design.
Strong interpersonal skills.
Ability to work in a dynamic product-oriented team.

Nice To Haves

Knowledge of CPU and/or GPU architecture.
CUDA or OpenCL programming experience.
Experience with MLIR, LLVM, XLA, TVM.
Experience with deep learning models and algorithms.

Responsibilities

Design and implement compiler transformations.
Develop MLIR-based dialects and lowering passes.
Optimize the performance of tile-based kernels for efficient execution across multiple generations of NVIDIA GPU and LPU architectures.
Define public APIs.
Craft and implement compiler and optimization techniques.
Performance optimization.
General software engineering work.