discover · compare · collections · requirements · contribute · feed · watching · stats · help with your tokens
kvcache-ai/Mooncake
Mooncake is the serving platform for Kimi, a leading LLM service provided by Moonshot AI.
History and source changes · Reports and owner responses · Compare
Similar
- PufferAI/PufferLib
Puffing up reinforcement learning
Why this match
topics reinforcement-learning; language differs: C++ → C; license differs: Apache-2.0 → MIT
- xorbitsai/inference
Swap GPT for any LLM by changing a single line of code. Xinference lets you run open-source, speech, and multimodal models on cloud, on-prem, or your laptop — all through one unified, production-ready inference API.
Why this match
topics inference, llm, sglang; language differs: C++ → Python
- Human-Agent-Society/reef
Infrastructure for continually self‑improving agents
Why this match
topics inference, llm, reinforcement-learning; language differs: C++ → Python
- uccl-project/uccl
UCCL is an efficient communication library for GPUs, covering collectives, P2P (e.g., KV cache transfer, RL weight transfer), and EP (e.g., GPU-driven)
Why this match
topics kvcache, llm, rdma
- LMCache/LMCache
LMCache: Supercharge Your LLM with the Fastest KV Cache Layer
Why this match
topics inference, llm, vllm; language differs: C++ → Python
- vllm-project/semantic-router
An open, programmable decision layer for models and compute.
Why this match
topics inference, llm, vllm; language differs: C++ → Go
- microsoft/agent-lightning
The absolute trainer to light up AI agents.
Why this match
topics llm, reinforcement-learning; language differs: C++ → Python; license differs: Apache-2.0 → MIT
- ai-dynamo/dynamo
A Datacenter Scale Distributed Inference Serving Framework
Why this match
topics sglang, vllm; language differs: C++ → Rust