feed · watching · stats · help with your tokens
nomic-ai/gpt4all
GPT4All: Run Local LLMs on Any Device. Open-source and available for commercial use.
Similar
- mistralai/mistral-inference
Official inference library for Mistral models
- Tiiny-AI/PowerInfer
High-speed Large Language Model Serving for Local Deployment
- liguodongiot/llm-action
本项目旨在分享大模型相关技术原理以及实战经验（大模型工程化、大模型应用落地）
- Lightning-AI/litgpt
20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale.
- onyx-dot-app/onyx
Open Source AI Platform - AI Chat with advanced features that works with every LLM
- tonyd2wild/The-Sparky-Command-Center
Plug-and-play, dependency-free web command center for DGX Spark fleets (and any GPU boxes): live per-node GPU/CPU/mem/temps/power, optional RouterOS switch monitoring, and per-model decode/prefill/TTFT/KV cards. Point it at your own hardware.
- flashinfer-ai/flashinfer
FlashInfer: Kernel Library for LLM Serving
- ai-dynamo/dynamo
A Datacenter Scale Distributed Inference Serving Framework