brainstate

MakazhanAlpamys/Soup

Fine-tune LLMs from one YAML. Layer streaming trains an 8B model on a 4 GB laptop GPU.

Python★ 10.1kApache-2.0GitHub ↗

History and source changes · Reports and owner responses · Compare

Similar

  1. huggingface/peft

    🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.

    Python★ 21.9kApache-2.0GitHub ↗

    Why this match

    topics fine-tuning, llm, lora

  2. bitsandbytes-foundation/bitsandbytes

    Accessible large language models via k-bit quantization for PyTorch.

    Python★ 8.5kMITGitHub ↗

    Why this match

    topics llm, machine-learning, pytorch; license differs: Apache-2.0 → MIT

  3. hiyouga/LlamaFactory

    Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)

    Python★ 75.9kApache-2.0GitHub ↗

    Why this match

    topics fine-tuning, llm, lora

  4. oumi-ai/oumi

    Easily fine-tune (SFT/RL), evaluate, and deploy Qwen, Gemma, or any open agentic LLM/VLM!

    Python★ 9.4kApache-2.0GitHub ↗

    Why this match

    topics dpo, fine-tuning, llm

  5. axolotl-ai-cloud/axolotl

    Go ahead and axolotl questions

    Python★ 12.7kApache-2.0GitHub ↗

    Why this match

    topics fine-tuning, llm

  6. intel/ipex-llm

    Accelerate local LLM inference and finetuning (LLaMA, Mistral, ChatGLM, Qwen, DeepSeek, Mixtral, Gemma, Phi, MiniCPM, Qwen-VL, MiniCPM-V, etc.) on Intel XPU (e.g., local PC with iGPU and NPU, discrete GPU such as Arc, Flex and Max); seamlessly integrate with llama.cpp, Ollama, HuggingFace, LangChain, LlamaIndex, vLLM, DeepSpeed, Axolotl, etc.

    Python★ 8.8kApache-2.0archivedGitHub ↗

    Why this match

    topics llm, pytorch, transformers

  7. Yashwanth-pilli/ILLIP

    Your AI company, in your device. Local-first AI platform: chat, agent crew, memory, and a model store sized to your hardware - from 4GB laptops to big GPUs. One-click setup, fully private.

    Python★ 27AGPL-3.0GitHub ↗

    Why this match

    topics llm, local-ai, local-llm; license differs: Apache-2.0 → AGPL-3.0

  8. ollama/ollama-python

    Ollama Python library

    Python★ 10.7kMITGitHub ↗

    Why this match

    topics ollama, python; license differs: Apache-2.0 → MIT