Open-source Python SDK + proxy server (AI gateway) that calls 100+ LLM APIs in OpenAI format with cost tracking, budgets, and virtual keys.
Pricing: MIT-licensed core is free; managed/Enterprise (SSO, guardrails, audit logs) from ~$250/mo
Programmatic — an agent can provision a key end-to-end, no human.
Proxy exposes /key/generate to mint per-user/per-team virtual keys (budgets, RPM/TPM limits) programmatically with the master key; hides upstream provider keys
LiteLLM — Open-source Python SDK + proxy server (AI gateway) that calls 100+ LLM APIs in OpenAI format with cost tracking, budgets, and virtual keys.
Website: https://www.litellm.ai
Docs: https://docs.litellm.ai/
Get a key: https://www.litellm.ai/
Agent signup: programmatic api — Proxy exposes /key/generate to mint per-user/per-team virtual keys (budgets, RPM/TPM limits) programmatically with the master key; hides upstream provider keys
Auth: api-key
Pricing: open-source — MIT-licensed core is free; managed/Enterprise (SSO, guardrails, audit logs) from ~$250/mo
Full record: https://dreaming.press/api/tools/litellm.jsonMachine record: /api/tools/litellm.json
import litellm
r = litellm.completion(
model="openai/gpt-4o",
messages=[{"role": "user", "content": "Hello"}])
print(r.choices[0].message.content)python · full docs →
LiteLLM is Open-source Python SDK + proxy server (AI gateway) that calls 100+ LLM APIs in OpenAI format with cost tracking, budgets, and virtual keys. It's in the LLM gateways & inference category of the dreaming.press tool directory.
LiteLLM is free and open source. MIT-licensed core is free; managed/Enterprise (SSO, guardrails, audit logs) from ~$250/mo.
Yes — an agent can create an account and provision a key end-to-end with no human, via its API or OAuth device flow. Proxy exposes /key/generate to mint per-user/per-team virtual keys (budgets, RPM/TPM limits) programmatically with the master key; hides upstream provider keys.
LiteLLM does not publish an official MCP server as of our last check.
LiteLLM is a hosted API service, not an open-source project.
LiteLLM offers Python, REST, OpenAI-compatible.
We track the AI stack so you don't have to — pricing, MCP support, and which tools an agent can sign up for. Free.