Lead Software Engineer - Kernels
About The Position
MatX is on a mission to be the compute platform for AGI. We are developing vertically integrated full-stack solutions from silicon to systems including hardware and software to train and run the largest ML workloads for AGI. We are seeking a hands-on engineering TLM to lead the Kernel team. You will manage, mentor, and grow a team of kernel engineers while setting technical direction and executing. At the same time, you will be an active coding contributor by designing and implementing high-performance compute kernels for specialized AI hardware. You will partner with the ML team to maximize output and improve diagnostic tools, and collaborate with hardware to co-design next-generation AI architectures.
Requirements
- 2+ years of engineering team management experience
- 7+ years of working directly within engineering teams experience
- Bachelor of Computer Science or equivalent degree
- Experience optimizing software for specialized hardware, employing techniques such as parallelism, SIMD programming, C, assembly-level optimization, or GPU/CUDA programming
- Language: at least one of assembly, C++, C, Zig, or Rust
- Ability to navigate ambiguity, manage escalations, and align stakeholders around infrastructure decisions.
- Excellent communication and collaboration skills, with a track record of translating complex technical trade-offs with the founders and stakeholders
- All candidates must be authorized to work in the United States and work from our offices in Mountain View Tuesdays-Thursdays.
- This position requires access to information that is subject to U.S. export controls. This offer of employment is contingent upon the applicants capacity to perform job functions in compliance with U.S. export control laws without obtaining a license from U.S. export control authorities.
Nice To Haves
- Experience implementing kernels for ML models such as Transformers
- Experience using and implementing distributed parallelism techniques such as AllReduce, AllToAll, data parallelism, tensor parallelism.
- Familiarity with how compilers work
Responsibilities
- Manage, mentor, and build a team of highly specialized kernel engineers and software developers
- Design and optimize kernels that interface directly with our hardware
- Work in partnership with our ML Research and Hardware Engineering teams
- Provide expertise and guidance on hardware architecture from a programmer's perspective, ensuring seamless integration with the software stack
Benefits
- A flexible cash equity compensation mix that fits your needs
- Company subsidized Health, Dental, Vision, and Life insurance
- Pre-tax Health Savings Accounts with generous company contribution
- 4 weeks paid time off (accrued)
- 12 company holidays
- 3 weeks remote/flexible work per year
- Up to 12 weeks of paid parental leave, regardless of your path to parenthood
- $1,500 yearly towards your professional development e.g. conferences, courses, and other learning opportunities
- Team Lunches, quarterly off-sites, and regular town halls
- 401K and/or Roth IRA, with 5% company contribution
- Pre-tax spend accounts for medical, dental/vision, dependent care, parking, and transit expenses
- For those commuting up to 1 hour, put your rideshare cost on our company card and reclaim the drive-time to get work done!
- $50 per month to use on the perks you care about most
- We work remotely Monday & Friday, supported by home-tech setup, and remote wifi expense reimbursement
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
What This Job Offers
Job Type
Full-time
Career Level
Entry Level
