discover · compare · collections · requirements · contribute · feed · watching · stats · help with your tokens
mistralai/mistral-inference
Official inference library for Mistral models
History and source changes · Reports and owner responses · Compare
Similar
- Tiiny-AI/PowerInfer
High-speed Large Language Model Serving for Local Deployment
Why this match
topics llm, llm-inference; language differs: Jupyter Notebook → C++; license differs: Apache-2.0 → MIT
- liguodongiot/llm-action
本项目旨在分享大模型相关技术原理以及实战经验（大模型工程化、大模型应用落地）
Why this match
topics llm, llm-inference; language differs: Jupyter Notebook → HTML
- Lightning-AI/litgpt
20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale.
Why this match
topics llm, llm-inference; language differs: Jupyter Notebook → Python
- nomic-ai/gpt4all
GPT4All: Run Local LLMs on Any Device. Open-source and available for commercial use.
Why this match
topics llm-inference; language differs: Jupyter Notebook → C++; license differs: Apache-2.0 → MIT
- tonyd2wild/The-Sparky-Command-Center
Plug-and-play, dependency-free web command center for DGX Spark fleets (and any GPU boxes): live per-node GPU/CPU/mem/temps/power, optional RouterOS switch monitoring, and per-model decode/prefill/TTFT/KV cards. Point it at your own hardware.
Why this match
topics llm, llm-inference; language differs: Jupyter Notebook → TypeScript; license differs: Apache-2.0 → MIT
- InternLM/lmdeploy
LMDeploy is a toolkit for compressing, deploying, and serving LLMs.
Why this match
topics llm, llm-inference; language differs: Jupyter Notebook → Python
- drumih/turbo-fieldfare
Gemma 4 26B-A4B inference in ~2 GB of RAM on any M-series MacBook
Why this match
topics llm, llm-inference; language differs: Jupyter Notebook → Swift
- bentoml/BentoML
The easiest way to serve AI apps and models - Build Model Inference APIs, Job queues, LLM apps, Multi-model pipelines, and more!
Why this match
topics llm, llm-inference; language differs: Jupyter Notebook → Python