discover · compare · collections · requirements · contribute · feed · watching · stats · help with your tokens
BerriAI/litellm
The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM]
History and source changes · Reports and owner responses · Compare
Similar
- Portkey-AI/gateway
A blazing fast AI Gateway with integrated guardrails. Route to 1,600+ LLMs, 50+ AI Guardrails with 1 fast & friendly API.
Why this match
topics ai-gateway, gateway, langchain; language differs: Python → TypeScript
- decolua/9router
Unlimited FREE AI coding. Connect Claude Code, Codex, Cursor, Cline, Copilot, Antigravity to FREE Claude/GPT/Gemini via 40+ providers. Auto-fallback, RTK -40% tokens, never hit limits.
Why this match
topics ai-gateway, anthropic, llm; language differs: Python → JavaScript
- vllora/vllora
Debug your AI agents
Why this match
topics ai-gateway, anthropic, langchain; language differs: Python → Rust
- ZiChuanLan/meta-gateway
OpenAI-compatible multi-channel LLM relay gateway with admin console
Why this match
topics ai-gateway, anthropic, llm; language differs: Python → Go
- tbphp/gpt-load
Self-hosted AI gateway for multi-channel, multi-credential setups — API keys and subscription accounts, scheduling, failover, request logs and usage. 自托管 AI 网关：多渠道多凭据统一接入，含密钥与订阅账号、调度容错、日志与用量。
Why this match
topics ai-gateway, anthropic, llm; language differs: Python → Go
- ConiferKit/use-conifer
The Conifer SDK — one gateway for cloud, local, and BYOK inference, with exact per-call cost receipts. TypeScript + Python + MCP.
Why this match
topics ai-gateway, anthropic, llm; language differs: Python → TypeScript
- katanemo/plano
Plano is an AI-native proxy server and data plane for agentic apps. Smart LLM routing, observability, agent orchestration, and guardrails so you stay focused on your agents core logic.
Why this match
topics ai-gateway, gateway, llm-gateway; language differs: Python → Rust
- cheaper-inference/OmniRoute
Never stop coding. Free MIT AI gateway: one endpoint, 375 providers (150+ free), 1,400+ models Kimi, Claude, GPT, Gemini, GLM, DeepSeek, MiniMax. Works with Claude Code, Codex, Cursor, OpenCode, Cline & Copilot. Quota-aware auto-fallback, RTK+Caveman compression saves 15-95% tokens, MCP/A2A, Desktop/PWA. Built by 900+ contributors
Why this match
topics ai-gateway, anthropic, llm-gateway; language differs: Python → TypeScript