brainstate

bitsandbytes-foundation/bitsandbytes

Accessible large language models via k-bit quantization for PyTorch.

Python★ 8.5kMITGitHub ↗

History and source changes · Reports and owner responses · Compare

Similar

  1. kuangliu/pytorch-cifar

    95.47% on CIFAR10 with PyTorch

    Python★ 6.4kMITGitHub ↗

    Why this match

    topics pytorch

  2. aymericdamien/TopDeepLearning

    A list of popular github projects related to deep learning

    Python★ 6.4kMITGitHub ↗

    Why this match

    topics machine-learning, pytorch

  3. ggml-org/ggml

    Tensor library for machine learning

    C++★ 15.6kMITGitHub ↗

    Why this match

    topics machine-learning; language differs: Python → C++

  4. intel/ipex-llm

    Accelerate local LLM inference and finetuning (LLaMA, Mistral, ChatGLM, Qwen, DeepSeek, Mixtral, Gemma, Phi, MiniCPM, Qwen-VL, MiniCPM-V, etc.) on Intel XPU (e.g., local PC with iGPU and NPU, discrete GPU such as Arc, Flex and Max); seamlessly integrate with llama.cpp, Ollama, HuggingFace, LangChain, LlamaIndex, vLLM, DeepSpeed, Axolotl, etc.

    Python★ 8.8kApache-2.0archivedGitHub ↗

    Why this match

    topics llm, pytorch; license differs: MIT → Apache-2.0

  5. hiyouga/LlamaFactory

    Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)

    Python★ 75.9kApache-2.0GitHub ↗

    Why this match

    topics llm, qlora, quantization; license differs: MIT → Apache-2.0

  6. MakazhanAlpamys/Soup

    Fine-tune LLMs from one YAML. Layer streaming trains an 8B model on a 4 GB laptop GPU.

    Python★ 10.1kApache-2.0GitHub ↗

    Why this match

    topics llm, machine-learning, pytorch; license differs: MIT → Apache-2.0

  7. higgsfield-ai/higgsfield

    Fault-tolerant, highly scalable GPU orchestration, and a machine learning framework designed for training models with billions to trillions of parameters

    Jupyter Notebook★ 6.3kApache-2.0archivedGitHub ↗

    Why this match

    topics llm, machine-learning, pytorch; language differs: Python → Jupyter Notebook; license differs: MIT → Apache-2.0

  8. meta-llama/llama-cookbook

    Welcome to the Llama Cookbook! This is your go to guide for Building with Llama: Getting started with Inference, Fine-Tuning, RAG. We also show you how to solve end to end problems using Llama model family and using them on various provider services

    Jupyter Notebook★ 18.6kMITGitHub ↗

    Why this match

    topics llm, machine-learning, pytorch; language differs: Python → Jupyter Notebook