brainstate

EleutherAI/gpt-neox

An implementation of model parallel autoregressive transformers on GPUs, based on the Megatron and DeepSpeed libraries

Python★ 7.5kApache-2.0GitHub ↗

History and source changes · Reports and owner responses · Compare

Similar

  1. EleutherAI/gpt-neo

    An implementation of model parallel GPT-2 and GPT-3-style models using the mesh-tensorflow library.

    Python★ 8.3kMITarchivedGitHub ↗

    Why this match

    topics gpt-3, language-model, transformers; license differs: Apache-2.0 → MIT

  2. BlinkDL/RWKV-LM

    RWKV (pronounced RwaKuv) is an RNN with great LLM performance, which can also be directly trained like a GPT transformer (parallelizable). We are at RWKV-7 "Goose". So it's combining the best of RNN and transformer - great performance, linear time, constant space (no kv-cache), fast training, infinite ctx_len, and free sentence embedding.

    Python★ 14.8kApache-2.0GitHub ↗

    Why this match

    topics gpt-3, language-model, transformers

  3. huggingface/tokenizers

    💥 Fast State-of-the-Art Tokenizers optimized for Research and Production

    Rust★ 11.2kApache-2.0GitHub ↗

    Why this match

    topics language-model, transformers; language differs: Python → Rust

  4. microsoft/LoRA

    Code for loralib, an implementation of "LoRA: Low-Rank Adaptation of Large Language Models"

    Python★ 13.9kMITGitHub ↗

    Why this match

    topics gpt-3, language-model; license differs: Apache-2.0 → MIT

  5. tatsu-lab/stanford_alpaca

    Code and documentation to train Stanford's Alpaca models, and generate the data.

    Python★ 30.2kApache-2.0GitHub ↗

    Why this match

    topics language-model

  6. EleutherAI/lm-evaluation-harness

    A framework for few-shot evaluation of language models.

    Python★ 14.4kMITGitHub ↗

    Why this match

    topics language-model; license differs: Apache-2.0 → MIT

  7. humanloop/awesome-chatgpt

    Curated list of awesome tools, demos, docs for ChatGPT and GPT-3

    ★ 8.2kGitHub ↗

    Why this match

    topics gpt-3

  8. intel/ipex-llm

    Accelerate local LLM inference and finetuning (LLaMA, Mistral, ChatGLM, Qwen, DeepSeek, Mixtral, Gemma, Phi, MiniCPM, Qwen-VL, MiniCPM-V, etc.) on Intel XPU (e.g., local PC with iGPU and NPU, discrete GPU such as Arc, Flex and Max); seamlessly integrate with llama.cpp, Ollama, HuggingFace, LangChain, LlamaIndex, vLLM, DeepSpeed, Axolotl, etc.

    Python★ 8.8kApache-2.0archivedGitHub ↗

    Why this match

    topics transformers