discover · compare · collections · requirements · contribute · feed · watching · stats · help with your tokens
maximhq/bifrost
Open-source, high-performance AI gateway that works as your LLM gateway, MCP gateway and agent gateway. One OpenAI-compatible API for 10,000+ models, with failover, load balancing, semantic caching, virtual keys, budgets and MCP Code Mode. Works with any SDK or agent and adds under 200µs of overhead at 5k RPS.
History and source changes · Reports and owner responses · Compare
Similar
- Portkey-AI/gateway
A blazing fast AI Gateway with integrated guardrails. Route to 1,600+ LLMs, 50+ AI Guardrails with 1 fast & friendly API.
Why this match
topics ai-gateway, gateway, llm-gateway; language differs: Go → TypeScript; license differs: Apache-2.0 → MIT
- TykTechnologies/tyk
Open Source API and AI Gateway supporting REST, GraphQL, TCP, gRPC and MCP (Model Context Protocol)
Why this match
topics ai-gateway, api-gateway, llm-gateway
- tbphp/gpt-load
Self-hosted AI gateway for multi-channel, multi-credential setups — API keys and subscription accounts, scheduling, failover, request logs and usage. 自托管 AI 网关：多渠道多凭据统一接入，含密钥与订阅账号、调度容错、日志与用量。
Why this match
topics ai-gateway, api-gateway, claude-code; license differs: Apache-2.0 → MIT
- BerriAI/litellm
The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM]
Why this match
topics ai-gateway, gateway, llm-gateway; language differs: Go → Python
- katanemo/plano
Plano is an AI-native proxy server and data plane for agentic apps. Smart LLM routing, observability, agent orchestration, and guardrails so you stay focused on your agents core logic.
Why this match
topics ai-gateway, gateway, llm-gateway; language differs: Go → Rust
- Kong/kong
🦍 The API and AI Gateway
Why this match
topics ai-gateway, api-gateway, llm-gateway; language differs: Go → Lua
- fjgbue/claude-delegator-deepseek-mcp
MCP server: delegate heavy-token tasks from Claude Code to DeepSeek, Kimi, GLM, Qwen, Grok, or any OpenAI-compatible model. Mix providers per task, cost receipt on every call. Zero dependencies.
Why this match
topics claude-code, model-context-protocol, openai-compatible; language differs: Go → JavaScript; license differs: Apache-2.0 → MIT
- higress-group/higress
🤖 AI Gateway | AI Native API Gateway
Why this match
topics ai-gateway, api-gateway