brainstate

microsoft/LoRA

Code for loralib, an implementation of "LoRA: Low-Rank Adaptation of Large Language Models"

Python★ 13.9kMITGitHub ↗

History and source changes · Reports and owner responses · Compare

Similar

  1. EleutherAI/gpt-neo

    An implementation of model parallel GPT-2 and GPT-3-style models using the mesh-tensorflow library.

    Python★ 8.3kMITarchivedGitHub ↗

    Why this match

    topics gpt-2, gpt-3, language-model

  2. BlinkDL/RWKV-LM

    RWKV (pronounced RwaKuv) is an RNN with great LLM performance, which can also be directly trained like a GPT transformer (parallelizable). We are at RWKV-7 "Goose". So it's combining the best of RNN and transformer - great performance, linear time, constant space (no kv-cache), fast training, infinite ctx_len, and free sentence embedding.

    Python★ 14.8kApache-2.0GitHub ↗

    Why this match

    topics deep-learning, gpt-2, gpt-3; license differs: MIT → Apache-2.0

  3. EleutherAI/gpt-neox

    An implementation of model parallel autoregressive transformers on GPUs, based on the Megatron and DeepSpeed libraries

    Python★ 7.5kApache-2.0GitHub ↗

    Why this match

    topics gpt-3, language-model; license differs: MIT → Apache-2.0

  4. OpenNMT/OpenNMT-py

    Open Source Neural Machine Translation and (Large) Language Models in PyTorch

    Python★ 7.0kMITGitHub ↗

    Why this match

    topics deep-learning, language-model, pytorch

  5. tatsu-lab/stanford_alpaca

    Code and documentation to train Stanford's Alpaca models, and generate the data.

    Python★ 30.2kApache-2.0GitHub ↗

    Why this match

    topics deep-learning, language-model; license differs: MIT → Apache-2.0

  6. OptimalScale/LMFlow

    An Extensible Toolkit for Finetuning and Inference of Large Foundation Models. Large Models for All.

    Python★ 8.5kApache-2.0GitHub ↗

    Why this match

    topics deep-learning, language-model, pytorch; license differs: MIT → Apache-2.0

  7. kuangliu/pytorch-cifar

    95.47% on CIFAR10 with PyTorch

    Python★ 6.4kMITGitHub ↗

    Why this match

    topics pytorch

  8. microsoft/JARVIS

    JARVIS, a system to connect LLMs with ML community. Paper: https://arxiv.org/pdf/2303.17580.pdf

    Python★ 25.6kMITGitHub ↗

    Why this match

    topics deep-learning, pytorch