Join a small AI infrastructure team working to improve the performance and efficiency of large language model inference. The role contributes across software systems, GPU kernels, and production deployments to deliver fast, reliable inference across diverse hardware. The position involves bringing support for new open-source models to production and tuning them for latency and throughput; optimizing inference serving; writing and tuning GPU kernels; designing, deploying, and operating heterogeneous compute clusters; and maintaining production inference systems with a focus on reliability, observability, and cost efficiency. The role requires autonomous work on technical problems and collaboration with customers and teammates to guide solutions. The position is on-site in San Francisco, California, five days per week. Base salary is $200,000 to $300,000 annually. Visa sponsorship is available.
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
Job Type
Full-time
Career Level
Entry Level
Education Level
No Education Listed