LiteLLM is hiring senior and staff backend engineers to own the core of its open-source AI Gateway and keep it fast and reliable as traffic grows. LiteLLM is used by companies including Adobe, Netflix, NASA, and NVIDIA, and handles more than 1 billion requests per month. The role owns critical components of the LiteLLM proxy, including routing, authentication, caching, spend tracking, guardrails, and observability. The engineer will make these systems correct, fast, and dependable by diagnosing root causes, eliminating silent failures, and refactoring unreliable components without changing their behavior. They will also set a high standard for backend engineering practices on a mostly early-career team.
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
Job Type
Full-time
Career Level
Senior