discover · compare · collections · requirements · contribute · feed · watching · stats · help with your tokens
Portkey-AI/gateway
A blazing fast AI Gateway with integrated guardrails. Route to 1,600+ LLMs, 50+ AI Guardrails with 1 fast & friendly API.
History and source changes · Reports and owner responses · Compare
Similar
- BerriAI/litellm
The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM]
Why this match
topics ai-gateway, gateway, langchain; language differs: TypeScript → Python
- katanemo/plano
Plano is an AI-native proxy server and data plane for agentic apps. Smart LLM routing, observability, agent orchestration, and guardrails so you stay focused on your agents core logic.
Why this match
topics ai-gateway, gateway, generative-ai; language differs: TypeScript → Rust; license differs: MIT → Apache-2.0
- modelcontextprotocol/registry
A community driven registry service for Model Context Protocol (MCP) servers.
Why this match
topics mcp, mcp-servers; language differs: TypeScript → Go
- maximhq/bifrost
Open-source, high-performance AI gateway that works as your LLM gateway, MCP gateway and agent gateway. One OpenAI-compatible API for 10,000+ models, with failover, load balancing, semantic caching, virtual keys, budgets and MCP Code Mode. Works with any SDK or agent and adds under 200µs of overhead at 5k RPS.
Why this match
topics ai-gateway, gateway, llm-gateway; language differs: TypeScript → Go; license differs: MIT → Apache-2.0
- NirDiamant/GenAI_Agents
50+ tutorials and implementations for Generative AI Agent techniques, from basic conversational bots to complex multi-agent systems.
Why this match
topics generative-ai, langchain, llm; language differs: TypeScript → Jupyter Notebook
- ConiferKit/use-conifer
The Conifer SDK — one gateway for cloud, local, and BYOK inference, with exact per-call cost receipts. TypeScript + Python + MCP.
Why this match
topics ai-gateway, llm, mcp; license differs: MIT → Apache-2.0
- simonw/llm
Access large language models from the command-line
Why this match
topics llms, openai; language differs: TypeScript → Python; license differs: MIT → Apache-2.0
- vllora/vllora
Debug your AI agents
Why this match
topics ai-gateway, langchain, llm; language differs: TypeScript → Rust