Staff Engineer, Systems and Reliability

LiteLLM•San Francisco, CA
•$250,000 - $350,000•Onsite

About The Position

LiteLLM is hiring a hands-on Staff Engineer to own the stability and reliability of its AI Gateway, a mission-critical system used by thousands of companies to run AI in production. The engineer will identify the underlying causes of regressions and security issues and refactor or rewrite code so those problems do not recur across the codebase. They will improve code quality through implementation and review, build a trustworthy test suite, and help ensure that failures are detected before customers experience them. The role works with the security and infrastructure team and reports to the CEO, later transitioning to reporting to the Head of Engineering. It is an in-person position in San Francisco. LiteLLM supports relocation and H-1B transfers. The technology stack includes Python, FastAPI, Redis, and Postgres, with the gateway moving to Rust.

Requirements

  • At least 3 years of experience, with rapidly increasing scope at a strong engineering company; scope owned matters more than having held a Staff title.
  • Experience owning stability or reliability at a current company.
  • Experience owning mission-critical production systems and leading rewrites or code migrations.
  • Ability to enter an unfamiliar codebase and identify root causes.
  • First-principles problem-solving, including independently reasoning through difficult bugs and large refactors and carefully reviewing AI-written code.
  • Customer empathy and consideration of user impact before shipping changes.
  • Strong software engineering fundamentals, preferably in Python.

Nice To Haves

  • Rust experience.
  • Experience maintaining healthy CI on an open-source project with substantial outside contributions.
  • Experience at an early-stage startup.

Responsibilities

  • Find and fix root causes of regressions and security issues, including the patterns that create them.
  • Lead refactors, rewrites, and migrations of core product code while maintaining a highly available system.
  • Determine what makes the test suite trustworthy and build it.
  • Keep CI and releases fast and trustworthy while supporting a large open-source contributor base.
  • Review important code paths and raise engineering quality through code and review.
  • Raise quality across the team without becoming a bottleneck.
  • Own the stability and reliability of the gateway and help detect problems before customers do.

Benefits

  • Relocation assistance.
  • H-1B transfer support.
  • Competitive salary and equity.
  • Health insurance.
  • Dental insurance.
  • Vision insurance.
© 2026 Teal Labs, Inc
Privacy PolicyTerms of Service