System Engineer (Token Factory)

Nebius

About The Position

Token Factory is a part of Nebius Cloud, one of the world’s largest GPU clouds, running tens of thousands of GPUs. We are building an inference platform that makes every kind of foundation model — text, vision, audio, and emerging multimodal architectures — fast, reliable, and effortless to deploy at massive scale.

Requirements

Strong proficiency in C++, OR expertise in GPU programming with a focus on low-level high-performance coding and memory management
Experience in GPU programming or systems-level software development, e.g. operating system internals, kernel modules, or device drivers
Hands-on experience with profiling and debugging tools to identify performance issues on both CPUs and GPUs, and the ability to optimize code based on those findings.
Solid understanding of CPU/GPU architecture and memory hierarchy

Nice To Haves

Experience with GPU computing programming: CUDA, ROCm, CUTLASS, Cute, ThunderKittens, Triton, Pallas, Mosaic GPU
Familiarity with ML inference runtimes (e.g. TensorRT, TVM)
Knowledge of Linux internals, drivers, or compiler toolchains
Experience with tools like perf, VTune, Nsight, or ROCm profiler
Familiarity with popular inference engines (e.g. such as vLLM, sglang, TGI)

Responsibilities

Develop and optimize low-level kernels and runtime components for AI inference
Improve performance of inference engines GPU platforms
Profile and debug system-level and hardware-level performance issues
Integrate support for new hardware architectures (Hopper, Blackwell, Rubin)
Collaborate with ML and backend teams to optimize end-to-end execution

Benefits

Competitive salary and comprehensive benefits package.
Opportunities for professional growth within Nebius.
Flexible working arrangements.
A dynamic and collaborative work environment that values initiative and innovation.

Stand Out From the Crowd

Upload your resume and get instant feedback on how well it matches this job.

Upload and Match Resume