About The Position

Token Factory is a part of Nebius Cloud, one of the world’s largest GPU clouds, running tens of thousands of GPUs. We are building an inference platform that makes every kind of foundation model — text, vision, audio, and emerging multimodal architectures — fast, reliable, and effortless to deploy at massive scale.

Requirements

  • Strong proficiency in C++, OR expertise in GPU programming with a focus on low-level high-performance coding and memory management
  • Experience in GPU programming or systems-level software development, e.g. operating system internals, kernel modules, or device drivers
  • Hands-on experience with profiling and debugging tools to identify performance issues on both CPUs and GPUs, and the ability to optimize code based on those findings.
  • Solid understanding of CPU/GPU architecture and memory hierarchy

Nice To Haves

  • Experience with GPU computing programming: CUDA, ROCm, CUTLASS, Cute, ThunderKittens, Triton, Pallas, Mosaic GPU
  • Familiarity with ML inference runtimes (e.g. TensorRT, TVM)
  • Knowledge of Linux internals, drivers, or compiler toolchains
  • Experience with tools like perf, VTune, Nsight, or ROCm profiler
  • Familiarity with popular inference engines (e.g. such as vLLM, sglang, TGI)

Responsibilities

  • Develop and optimize low-level kernels and runtime components for AI inference
  • Improve performance of inference engines GPU platforms
  • Profile and debug system-level and hardware-level performance issues
  • Integrate support for new hardware architectures (Hopper, Blackwell, Rubin)
  • Collaborate with ML and backend teams to optimize end-to-end execution

Benefits

  • Competitive salary and comprehensive benefits package.
  • Opportunities for professional growth within Nebius.
  • Flexible working arrangements.
  • A dynamic and collaborative work environment that values initiative and innovation.

Stand Out From the Crowd

Upload your resume and get instant feedback on how well it matches this job.

Upload and Match Resume

What This Job Offers

Job Type

Full-time

Career Level

Mid Level

Education Level

No Education Listed

Number of Employees

1,001-5,000 employees

© 2024 Teal Labs, Inc
Privacy PolicyTerms of Service