Senior Security Engineer, Product & Platform

LiteLLM • San Francisco, CA

2d

About The Position

LiteLLM is hiring a Senior Security Engineer to secure its open-source AI Gateway, application, infrastructure, and software delivery pipeline. This is a hands-on individual-contributor role reporting to the security lead. The engineer will work directly with engineers to review and harden LiteLLM’s Python codebase, secure releases, and integrate security into the development process.

The role involves independently owning a security roadmap, implementing improvements, making day-to-day decisions, prioritizing competing risks, and communicating the tradeoffs behind those decisions. San Francisco is preferred but not required. The ideal candidate has built and owned a product, platform, or infrastructure security program and can turn security findings into lasting engineering improvements.

LiteLLM provides a unified API for LLM providers, with routing, authentication, budgets, observability, and governance for production AI systems.

Requirements

• 7+ years of relevant experience, including independent ownership of a security scope.
• Experience hardening a production CI/CD pipeline, including GitHub Actions permissions and keyless signing.
• Strong knowledge of a major cloud provider, preferably AWS, including IAM, secrets management, and workload identity.
• Familiarity with Terraform.
• Ability to read production Python web-service code, identify vulnerabilities, and implement fixes.
• Experience building security tooling and guardrails that engineering teams adopted.
• Strong judgment about prioritization and risk when several problems need attention at once.
• Excellent written and verbal communication, including the ability to coordinate across time zones independently.

Nice To Haves

• Experience as the first or second security hire at a developer-tools or open-source company.
• A background in software, platform, or infrastructure engineering.
• Experience leading platform or infrastructure security, defining roadmaps, and owning the security of releases.

Responsibilities

• Review and harden LiteLLM’s Python codebase, fixing vulnerabilities and addressing their underlying causes.
• Review sensitive pull requests and architecture changes before they reach production.
• Harden the build and release pipeline, including GitHub Actions permissions, workload identity, signing, and credential handling.
• Build and maintain automated controls for secrets detection, credential management, and software release integrity.
• Review cloud architecture, IAM, secrets management, and workload identity, and implement security improvements.
• Build guardrails and secure defaults that fit how engineers work.
• Document security architecture, decisions, and operating practices.
• Own delivery and ongoing maintenance of product and pipeline security improvements.

What This Job Offers

• Job Type: Full-time
• Career Level: Senior
• Education Level: No Education Listed