discover · compare · collections · requirements · contribute · feed · watching · stats · help with your tokens
FlashML-org/FreeToken
FreeToken brings datacenter-scale model serving to your desktop. Run massive models locally, fast and efficiently.
History and source changes · Reports and owner responses · Compare
Similar
- sgl-project/sglang
SGLang is a high-performance serving framework for large language models and multimodal models.
Why this match
topics glm, inference, minimax
- ollama/ollama
Get up and running with Kimi, GLM, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.
Why this match
topics glm, minimax, qwen; language differs: Python → Go; license differs: Apache-2.0 → MIT
- GeeeekExplorer/nano-vllm
Nano vLLM
Why this match
topics inference, transformer; license differs: Apache-2.0 → MIT
- vllm-project/vllm
A high-throughput and memory-efficient inference and serving engine for LLMs
Why this match
topics inference, moe, qwen
- ggml-org/whisper.cpp
Port of OpenAI's Whisper model in C/C++
Why this match
topics inference, transformer; language differs: Python → C++; license differs: Apache-2.0 → MIT
- triton-inference-server/server
The Triton Inference Server provides an optimized cloud and edge inferencing solution.
Why this match
topics edge, inference; license differs: Apache-2.0 → BSD-3-Clause
- huggingface/transformers
🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.
Why this match
topics glm, qwen, transformer
- SYSTRAN/faster-whisper
Faster Whisper transcription with CTranslate2
Why this match
topics inference, transformer; license differs: Apache-2.0 → MIT