brainstate

EleutherAI/gpt-neo

An implementation of model parallel GPT-2 and GPT-3-style models using the mesh-tensorflow library.

Python★ 8.3kMITarchivedGitHub ↗

History and source changes · Reports and owner responses · Compare

Similar

  1. EleutherAI/gpt-neox

    An implementation of model parallel autoregressive transformers on GPUs, based on the Megatron and DeepSpeed libraries

    Python★ 7.5kApache-2.0GitHub ↗

    Why this match

    topics gpt-3, language-model, transformers; license differs: MIT → Apache-2.0

  2. BlinkDL/RWKV-LM

    RWKV (pronounced RwaKuv) is an RNN with great LLM performance, which can also be directly trained like a GPT transformer (parallelizable). We are at RWKV-7 "Goose". So it's combining the best of RNN and transformer - great performance, linear time, constant space (no kv-cache), fast training, infinite ctx_len, and free sentence embedding.

    Python★ 14.8kApache-2.0GitHub ↗

    Why this match

    topics gpt, gpt-2, gpt-3; license differs: MIT → Apache-2.0

  3. huggingface/tokenizers

    💥 Fast State-of-the-Art Tokenizers optimized for Research and Production

    Rust★ 11.2kApache-2.0GitHub ↗

    Why this match

    topics gpt, language-model, transformers; language differs: Python → Rust; license differs: MIT → Apache-2.0

  4. microsoft/LoRA

    Code for loralib, an implementation of "LoRA: Low-Rank Adaptation of Large Language Models"

    Python★ 13.9kMITGitHub ↗

    Why this match

    topics gpt-2, gpt-3, language-model

  5. NielsRogge/Transformers-Tutorials

    This repository contains demos I made with the Transformers library by HuggingFace.

    Jupyter Notebook★ 11.8kMITGitHub ↗

    Why this match

    topics gpt-2, transformers; language differs: Python → Jupyter Notebook

  6. JimmyLv/BibiGPT-v1

    BibiGPT v1 · one-Click AI Summary for Audio/Video & Chat with Learning Content: Bilibili | YouTube | Tweet丨TikTok丨Dropbox丨Google Drive丨Local files | Websites丨Podcasts | Meetings | Lectures, etc. 音视频内容 AI 一键总结 & 对话:哔哩哔哩丨YouTube丨推特丨小红书丨抖音丨快手丨百度网盘丨阿里云盘丨网页丨播客丨会议丨本地文件等 (原 BiliGPT 省流神器 & AI课代表)

    TypeScript★ 6.3kGPL-3.0GitHub ↗

    Why this match

    topics gpt, gpt-3; language differs: Python → TypeScript; license differs: MIT → GPL-3.0

  7. FoundationVision/VAR

    [NeurIPS 2024 Best Paper Award][GPT beats diffusion🔥] [scaling laws in visual generation📈] Official impl. of "Visual Autoregressive Modeling: Scalable Image Generation via Next-Scale Prediction". An *ultra-simple, user-friendly yet state-of-the-art* codebase for autoregressive image generation!

    Jupyter Notebook★ 8.8kMITGitHub ↗

    Why this match

    topics gpt, gpt-2, transformers; language differs: Python → Jupyter Notebook

  8. swyxio/ai-notes

    notes for software engineers getting up to speed on new AI developments. Serves as datastore for https://latent.space writing, and product brainstorming, but has cleaned up canonical references under the /Resources folder.

    HTML★ 6.3kMITGitHub ↗

    Why this match

    topics gpt, gpt-3; language differs: Python → HTML