discover · compare · collections · requirements · contribute · feed · watching · stats · help with your tokens
intentee/paddler
Open-source LLM/VLM load balancer and serving platform for self-hosting LLMs (and VLMs) at scale 🏓🦙 Alternative to projects like llm-d, Docker Model Runner, etc but with less moving parts and simple deployments built around ggml ecosystem. Runs on CPU and GPU.
History and source changes · Reports and owner responses · Compare
Similar
- vibrantlabsai/ragas
Supercharge Your LLM Application Evaluations 🚀
Why this match
topics llm, llmops; language differs: Rust → Python
- 0xPlaygrounds/rig
⚙️🦀 Build modular and scalable LLM Applications in Rust
Why this match
topics ai, llm, llmops; license differs: Apache-2.0 → MIT
- liguodongiot/llm-action
本项目旨在分享大模型相关技术原理以及实战经验（大模型工程化、大模型应用落地）
Why this match
topics llm, llmops; language differs: Rust → HTML
- janhq/jan
Jan is an open source alternative to ChatGPT that runs 100% offline on your computer.
Why this match
topics llamacpp, llm
- Arindam200/awesome-ai-apps
A collection of projects showcasing RAG, agents, workflows, and other AI use cases
Why this match
topics ai, llm; language differs: Rust → Python; license differs: Apache-2.0 → MIT
- JushBJJ/Mr.-Ranedeer-AI-Tutor
A GPT-4 AI Tutor Prompt for customizable personalized learning experiences.
Why this match
topics ai, llm
- jujumilk3/leaked-system-prompts
Collection of leaked system prompts
Why this match
topics ai, llm
- kyrolabs/awesome-langchain
😎 Awesome list of tools and projects with the awesome LangChain framework
Why this match
topics ai, llm; license differs: Apache-2.0 → CC0-1.0