Member of Technical Staff

True Talent Solutions Partners•San Francisco, CA
•Onsite

About The Position

Join a small AI infrastructure team working to improve the performance and efficiency of large language model inference. The role contributes across software systems, GPU kernels, and production deployments to deliver fast, reliable inference across diverse hardware. The position involves bringing support for new open-source models to production and tuning them for latency and throughput; optimizing inference serving; writing and tuning GPU kernels; designing, deploying, and operating heterogeneous compute clusters; and maintaining production inference systems with a focus on reliability, observability, and cost efficiency. The role requires autonomous work on technical problems and collaboration with customers and teammates to guide solutions. The position is on-site in San Francisco, California, five days per week. Base salary is $200,000 to $300,000 annually. Visa sponsorship is available.

Requirements

  • One to six years of software engineering experience, including systems or low-level engineering close to hardware.
  • Strong understanding of computer architecture, memory hierarchy, and operating system internals.
  • Experience with backend, infrastructure, or systems work.
  • Familiarity with Python and GPU programming tools such as CUDA or Triton.
  • Evidence of strong technical ownership, rapid learning, and effective problem-solving.
  • Uses AI agents or coding tools to improve engineering workflows.

Nice To Haves

  • Background in machine learning inference optimization or operating large-scale infrastructure, such as clusters or GPU fleets.
  • Customer-facing experience.

Responsibilities

  • Bring support for new open-source models to production and tune them for latency and throughput.
  • Optimize inference serving, including batching, KV caching, speculative decoding, and quantization.
  • Write and tune GPU kernels using CUDA, HIP, and Triton across varied hardware platforms.
  • Design, deploy, and operate heterogeneous compute clusters.
  • Maintain production inference systems, focusing on reliability, observability, and cost efficiency.
  • Work autonomously on technical problems and collaborate with customers and teammates to guide solutions.
© 2026 Teal Labs, Inc
Privacy PolicyTerms of Service