discover · compare · collections · requirements · contribute · feed · watching · stats · help with your tokens
ai-dynamo/dynamo
A Datacenter Scale Distributed Inference Serving Framework
History and source changes · Reports and owner responses · Compare
Similar
- kvcache-ai/Mooncake
Mooncake is the serving platform for Kimi, a leading LLM service provided by Moonshot AI.
Why this match
topics sglang, vllm; language differs: Rust → C++
- tonyd2wild/The-Sparky-Command-Center
Plug-and-play, dependency-free web command center for DGX Spark fleets (and any GPU boxes): live per-node GPU/CPU/mem/temps/power, optional RouterOS switch monitoring, and per-model decode/prefill/TTFT/KV cards. Point it at your own hardware.
Why this match
topics llm-inference, vllm; language differs: Rust → TypeScript
- nomic-ai/gpt4all
GPT4All: Run Local LLMs on Any Device. Open-source and available for commercial use.
Why this match
topics llm-inference; language differs: Rust → C++
- youki-dev/youki
A container runtime written in Rust
Why this match
topics kubernetes, rust
- mistralai/mistral-inference
Official inference library for Mistral models
Why this match
topics llm-inference; language differs: Rust → Jupyter Notebook
- xorbitsai/inference
Swap GPT for any LLM by changing a single line of code. Xinference lets you run open-source, speech, and multimodal models on cloud, on-prem, or your laptop — all through one unified, production-ready inference API.
Why this match
topics sglang, vllm; language differs: Rust → Python
- linkerd/linkerd2
Ultralight, security-first service mesh for Kubernetes. Main repo for Linkerd 2.x.
Why this match
topics kubernetes, rust; language differs: Rust → Go
- k3s-io/k3s
Lightweight Kubernetes
Why this match
topics kubernetes; language differs: Rust → Go