discover · compare · collections · requirements · contribute · feed · watching · stats · help with your tokens
katanemo/plano
Plano is an AI-native proxy server and data plane for agentic apps. Smart LLM routing, observability, agent orchestration, and guardrails so you stay focused on your agents core logic.
History and source changes · Reports and owner responses · Compare
Similar
- Portkey-AI/gateway
A blazing fast AI Gateway with integrated guardrails. Route to 1,600+ LLMs, 50+ AI Guardrails with 1 fast & friendly API.
Why this match
topics ai-gateway, gateway, generative-ai; language differs: Rust → TypeScript; license differs: Apache-2.0 → MIT
- coaidev/coai
🚀 Next Gen Multi-tenant AI One-Stop Solution. Builtin Admin & Billing System. Enterprise-Grade Unified LLM Gateway Support for 200+ Models And 35+ Providers, Load Balacing w/ Priority-base Routing, Cost Management, Chat Share, Cloud Sync, Credit/Subscription Billing, All File Parsing, Web Search, Built-in Model Cache.
Why this match
topics ai-gateway, llm-gateway, openai; language differs: Rust → TypeScript
- BerriAI/litellm
The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM]
Why this match
topics ai-gateway, gateway, llm-gateway; language differs: Rust → Python
- simonw/llm
Access large language models from the command-line
Why this match
topics llms, openai; language differs: Rust → Python
- higress-group/higress
🤖 AI Gateway | AI Native API Gateway
Why this match
topics ai-gateway, envoy; language differs: Rust → Go
- transitive-bullshit/agentic
Your API ⇒ Paid MCP. Instantly.
Why this match
topics llms, openai; language differs: Rust → TypeScript
- liguodongiot/llm-action
本项目旨在分享大模型相关技术原理以及实战经验（大模型工程化、大模型应用落地）
Why this match
topics llm-inference, llmops; language differs: Rust → HTML
- maximhq/bifrost
Open-source, high-performance AI gateway that works as your LLM gateway, MCP gateway and agent gateway. One OpenAI-compatible API for 10,000+ models, with failover, load balancing, semantic caching, virtual keys, budgets and MCP Code Mode. Works with any SDK or agent and adds under 200µs of overhead at 5k RPS.
Why this match
topics ai-gateway, gateway, llm-gateway; language differs: Rust → Go