AI Gateway tool profile
LiteLLM
LiteLLM is an open-source AI gateway that puts 100+ LLM providers behind one OpenAI-compatible API, with virtual keys and teams, spend tracking, budgets and rate limits, LLM fallbacks, request/response logging, and Prometheus metrics. The core gateway is free to self-host; an Enterprise edition adds governance, security, and support, priced annually by request capacity and never per token.
- Best for
- Developers and platform teams who want a self-hosted, free AI gateway with granular spend control, virtual keys, and fallbacks — without per-token platform fees.
- Starting point
- Open source and self-hosted is free forever ($0): 100+ providers behind one OpenAI-compatible API with virt...
- Free plan
- Free tier available
- Key limitation
- Self-hosted: you run and maintain the gateway (PostgreSQL plus optional Redis), so uptime, upgrades, and operations are on you.
Where it fits
Developers and platform teams who want a self-hosted, free AI gateway with granular spend control, virtual keys, and fallbacks — without per-token platform fees.
Pricing note
Open source and self-hosted is free forever ($0): 100+ providers behind one OpenAI-compatible API with virtual keys, users and teams, spend tracking, budgets and rate limits, LLM fallbacks, request/response logging, and Prometheus metrics. Enterprise is priced annually by gateway request capacity (never per token) and adds SSO/SCIM, OIDC/JWT auth, audit logs, secret managers and key rotation, org and team admins, multi-region control plane, 24/7 support with SLAs, and air-gap deployment; a 30-day trial key is available without a credit card. Verified 2026-08-14 on litellm.ai/pricing.
Verify the current plan, credits, output limits, and commercial terms before purchasing.
Is it legit?
Who is behind LiteLLM, where it is based, and what is publicly known about its funding. Company details change — verify on the official site before committing.
Trade-offs to check
- Self-hosted: you run and maintain the gateway (PostgreSQL plus optional Redis), so uptime, upgrades, and operations are on you.
- Enterprise governance features (SSO/SCIM, audit logs, secret managers, SLAs) require the paid Enterprise edition.
- Independent open-source project (BerriAI) — not an official product of OpenAI, Anthropic, Google, or any listed provider.
Evaluation guide
Step-by-step evaluation guides for LiteLLM — workflow fit, pricing, rights, and a same-input test before paying.
Compare LiteLLM with alternatives
Side-by-side pages that weigh LiteLLM against overlapping tools on the same five fields.
Where LiteLLM appears
Best-of lists and roundups that include LiteLLM.
Official sources
These links are retained beside the catalog record so changing details can be rechecked.