Software Engineer - Kernels

MatX•Mountain View, CA

4h•Hybrid

About The Position

MatX is building the compute platform for AGI, developing vertically integrated full-stack solutions from silicon to systems, including hardware and software, to train and run the largest ML workloads for AGI. The Software Engineer will design and optimize kernels that interface directly with their hardware, work in partnership with ML Research and Hardware Engineering teams, and provide expertise and guidance on hardware architecture from a programmer's perspective to ensure seamless integration with the software stack. The primary programming language used is Rust.

Requirements

Bachelor of Computer Science or equivalent degree
5+ years of software development experience
Experience optimizing software for specialized hardware, employing techniques such as parallelism, SIMD programming, C, assembly-level optimization, or GPU/CUDA programming
Language: at least one of assembly, C++, C, Zig, or Rust
Must be authorized to work in the United States
Must be able to work from our offices in Mountain View Tuesdays-Thursdays
Capacity to perform job functions in compliance with U.S. export control laws without obtaining a license from U.S. export control authorities

Nice To Haves

Experience implementing kernels for ML models such as Transformers
Experience using and implementing distributed parallelism techniques such as AllReduce, AllToAll, data parallelism, tensor parallelism
Familiarity with how compilers work

Responsibilities

Design and optimize kernels that interface directly with our hardware
Work in partnership with our ML Research and Hardware Engineering teams
Provide expertise and guidance on hardware architecture from a programmer's perspective, ensuring seamless integration with the software stack