LiteLLM is hiring an ML Engineer to help build its next generation of AI infrastructure and its second product. The role focuses on unifying how applications call LLM APIs across the broader OpenAI and Anthropic specifications. This includes transforming OpenAI- and Anthropic-format requests into provider-specific formats and developing provider-agnostic capabilities, such as session management for non-OpenAI models through the /v1/responses API. The ML Engineer will work directly with the CEO and CTO on system design for bringing provider-level features to the gateway, including skills, compaction, and batches. The role also involves improving the developer experience for users of LiteLLM's Python SDK and maintaining interoperability across LLMs, MCPs, and agents, including supporting MCP authentication flows and agent use cases. LiteLLM's tech stack includes Python, FastAPI, Redis, and Postgres.
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
Job Type
Full-time
Career Level
Entry Level
Education Level
No Education Listed