LiteLLM is hiring a hands-on Staff Engineer to own the stability and reliability of its AI Gateway, a mission-critical system used by thousands of companies to run AI in production. The engineer will identify the underlying causes of regressions and security issues and refactor or rewrite code so those problems do not recur across the codebase. They will improve code quality through implementation and review, build a trustworthy test suite, and help ensure that failures are detected before customers experience them. The role works with the security and infrastructure team and reports to the CEO, later transitioning to reporting to the Head of Engineering. It is an in-person position in San Francisco. LiteLLM supports relocation and H-1B transfers. The technology stack includes Python, FastAPI, Redis, and Postgres, with the gateway moving to Rust.
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
Job Type
Full-time
Career Level
Senior
Education Level
No Education Listed