brainstate

bigscience-workshop/petals

🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading

Python★ 10.7kMITGitHub ↗

History and source changes · Reports and owner responses · Compare

Similar

  1. huggingface/text-generation-inference

    Large Language Model Text Generation Inference

    Python★ 10.9kApache-2.0archivedGitHub ↗

    Why this match

    topics bloom, deep-learning, falcon; license differs: MIT → Apache-2.0

  2. GeeeekExplorer/nano-vllm

    Nano vLLM

    Python★ 16.3kMITGitHub ↗

    Why this match

    topics deep-learning, nlp, pytorch

  3. NLP-LOVE/ML-NLP

    此项目是机器学习(Machine Learning)、深度学习(Deep Learning)、NLP面试中常考到的知识点和代码实现,也是作为一个算法工程师必会的理论基础知识。

    Jupyter Notebook★ 17.8kGitHub ↗

    Why this match

    topics deep-learning, machine-learning, nlp; language differs: Python → Jupyter Notebook

  4. OptimalScale/LMFlow

    An Extensible Toolkit for Finetuning and Inference of Large Foundation Models. Large Models for All.

    Python★ 8.5kApache-2.0GitHub ↗

    Why this match

    topics deep-learning, pretrained-models, pytorch; license differs: MIT → Apache-2.0

  5. NVIDIA/FasterTransformer

    Transformer related optimization, including BERT, GPT

    C++★ 6.5kApache-2.0GitHub ↗

    Why this match

    topics gpt, pytorch, transformer; language differs: Python → C++; license differs: MIT → Apache-2.0

  6. google-deepmind/lab

    A customisable 3D platform for agent-based AI research

    C★ 7.4kGitHub ↗

    Why this match

    topics deep-learning, machine-learning, neural-networks; language differs: Python → C

  7. yunjey/pytorch-tutorial

    PyTorch Tutorial for Deep Learning Researchers

    Python★ 32.5kMITGitHub ↗

    Why this match

    topics deep-learning, neural-networks, pytorch

  8. nndl/nndl

    邱锡鹏《神经网络与深度学习》第二版与通识版:电子书、章节目录、学习资源与勘误。

    ★ 19.6kGitHub ↗

    Why this match

    topics deep-learning, machine-learning, neural-networks