discover · compare · collections · requirements · contribute · feed · watching · stats · help with your tokens
Tiiny-AI/PowerInfer
High-speed Large Language Model Serving for Local Deployment
History and source changes · Reports and owner responses · Compare
Similar
- Lightning-AI/litgpt
20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale.
Why this match
topics large-language-models, llm, llm-inference; language differs: C++ → Python; license differs: MIT → Apache-2.0
- cocktailpeanut/dalai
The simplest way to run LLaMA on your local machine
Why this match
topics llama, llm; language differs: C++ → CSS
- 01-ai/Yi
A series of large language models trained from scratch by developers @01-ai
Why this match
topics large-language-models; language differs: C++ → Jupyter Notebook; license differs: MIT → Apache-2.0
- mistralai/mistral-inference
Official inference library for Mistral models
Why this match
topics llm, llm-inference; language differs: C++ → Jupyter Notebook; license differs: MIT → Apache-2.0
- GreyDGL/PentestGPT
Automated Penetration Testing Agentic Framework Powered by Large Language Models
Why this match
topics large-language-models, llm; language differs: C++ → Python
- arcee-ai/mergekit
Tools for merging pretrained large language models.
Why this match
topics llama, llm; language differs: C++ → Python; license differs: MIT → LGPL-3.0
- eugeneyan/open-llms
📋 A list of open LLMs available for commercial use.
Why this match
topics large-language-models, llm; license differs: MIT → Apache-2.0
- liguodongiot/llm-action
本项目旨在分享大模型相关技术原理以及实战经验（大模型工程化、大模型应用落地）
Why this match
topics llm, llm-inference; language differs: C++ → HTML; license differs: MIT → Apache-2.0