discover · compare · collections · requirements · contribute · feed · watching · stats · help with your tokens
bentoml/OpenLLM
Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.
History and source changes · Reports and owner responses · Compare
Similar
- liguodongiot/llm-action
本项目旨在分享大模型相关技术原理以及实战经验（大模型工程化、大模型应用落地）
Why this match
topics llm, llm-inference, llm-serving; language differs: Python → HTML
- axolotl-ai-cloud/axolotl
Go ahead and axolotl questions
Why this match
topics fine-tuning, llm
- higgsfield-ai/higgsfield
Fault-tolerant, highly scalable GPU orchestration, and a machine learning framework designed for training models with billions to trillions of parameters
Why this match
topics llama, llama2, llm; language differs: Python → Jupyter Notebook
- bentoml/BentoML
The easiest way to serve AI apps and models - Build Model Inference APIs, Job queues, LLM apps, Multi-model pipelines, and more!
Why this match
topics llm, llm-inference, llm-serving
- Tiiny-AI/PowerInfer
High-speed Large Language Model Serving for Local Deployment
Why this match
topics llama, llm, llm-inference; language differs: Python → C++; license differs: Apache-2.0 → MIT
- ludwig-ai/ludwig
Low-code framework for building custom LLMs, neural networks, and other AI models
Why this match
topics fine-tuning, llama, llama2
- zenml-io/mcp-zenml
MCP server to connect an MCP client (Cursor, Claude Desktop etc) with your ZenML MLOps and LLMOps pipelines
Why this match
topics llmops, mlops; license differs: Apache-2.0 → MIT
- cocktailpeanut/dalai
The simplest way to run LLaMA on your local machine
Why this match
topics llama, llm; language differs: Python → CSS