Member of Technical Staff

True Talent Solutions Partners•San Francisco, CA
•Onsite

About The Position

Join a small AI infrastructure team working to improve the performance and energy efficiency of large language model inference. Build and operate systems that serve open-source models across a range of hardware, with ownership spanning low-level optimization through production deployment. The position is on-site in San Francisco, California, five days per week. Base salary is $200,000 to $300,000 annually. Visa sponsorship is available.

Requirements

  • Typically 1 to 6 years of experience in backend, infrastructure, or systems engineering, including low-level work beyond application development.
  • Strong understanding of computer architecture, memory hierarchy, and operating system internals.
  • Experience with CUDA, Triton, or GPU programming.
  • Knowledge of ML inference optimization, such as quantization, batching, KV caching, or speculative decoding.
  • Experience deploying or operating infrastructure at scale, such as clusters or large GPU fleets.
  • Strong computer science fundamentals and evidence of ownership, rapid learning, or accomplishment on challenging technical work.
  • Comfort using AI coding tools to improve engineering workflows and communicating with customers as part of the role.

Nice To Haves

  • Familiarity with HIP and heterogeneous accelerators is useful.
  • Relevant internships for early-career candidates and new graduates.

Responsibilities

  • Deliver support for new open-source models and tune them for latency and throughput.
  • Optimize inference serving, including batching, KV cache management, speculative decoding, and quantization.
  • Write and tune GPU kernels using CUDA, HIP, and Triton across heterogeneous hardware.
  • Design, deploy, and operate clusters spanning multiple hardware vendors.
  • Run production inference systems, improving reliability, observability, and cost per token.
  • Work with customers to understand their needs and solve infrastructure challenges.

Benefits

  • Visa sponsorship is available.
© 2026 Teal Labs, Inc
Privacy PolicyTerms of Service