discover · compare · collections · requirements · contribute · feed · watching · stats · help with your tokens
InternLM/lmdeploy
LMDeploy is a toolkit for compressing, deploying, and serving LLMs.
History and source changes · Reports and owner responses · Compare
Similar
- Tiiny-AI/PowerInfer
High-speed Large Language Model Serving for Local Deployment
Why this match
topics llama, llm, llm-inference; language differs: Python → C++; license differs: Apache-2.0 → MIT
- yangjianxin1/Firefly
Firefly: 大模型训练工具，支持训练Qwen2.5、Qwen2、Yi1.5、Phi-3、Llama3、Gemma、MiniCPM、Yi、Deepseek、Orion、Xverse、Mixtral-8x7B、Zephyr、Mistral、Baichuan2、Llma2、Llama、Qwen、Baichuan、ChatGLM2、InternLM、Ziya2、Vicuna、Bloom等大模型
Why this match
topics internlm, llama, llama2
- cocktailpeanut/dalai
The simplest way to run LLaMA on your local machine
Why this match
topics llama, llm; language differs: Python → CSS
- getumbrel/llama-gpt
A self-hosted, offline, ChatGPT-like chatbot. Powered by Llama 2. 100% private, with no data leaving your device. New: Code Llama support!
Why this match
topics codellama, llama, llama2; language differs: Python → TypeScript; license differs: Apache-2.0 → MIT
- higgsfield-ai/higgsfield
Fault-tolerant, highly scalable GPU orchestration, and a machine learning framework designed for training models with billions to trillions of parameters
Why this match
topics llama, llama2, llm; language differs: Python → Jupyter Notebook
- meta-llama/llama-cookbook
Welcome to the Llama Cookbook! This is your go to guide for Building with Llama: Getting started with Inference, Fine-Tuning, RAG. We also show you how to solve end to end problems using Llama model family and using them on various provider services
Why this match
topics llama, llama2, llm; language differs: Python → Jupyter Notebook; license differs: Apache-2.0 → MIT
- mistralai/mistral-inference
Official inference library for Mistral models
Why this match
topics llm, llm-inference; language differs: Python → Jupyter Notebook
- arcee-ai/mergekit
Tools for merging pretrained large language models.
Why this match
topics llama, llm; license differs: Apache-2.0 → LGPL-3.0