brainstate

huggingface/text-generation-inference

Large Language Model Text Generation Inference

Python★ 10.9kApache-2.0archivedGitHub ↗

History and source changes · Reports and owner responses · Compare

Similar

  1. GeeeekExplorer/nano-vllm

    Nano vLLM

    Python★ 16.3kMITGitHub ↗

    Why this match

    topics deep-learning, inference, nlp; license differs: Apache-2.0 → MIT

  2. bigscience-workshop/petals

    🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading

    Python★ 10.7kMITGitHub ↗

    Why this match

    topics bloom, deep-learning, falcon; license differs: Apache-2.0 → MIT

  3. NVIDIA/FasterTransformer

    Transformer related optimization, including BERT, GPT

    C++★ 6.5kApache-2.0GitHub ↗

    Why this match

    topics gpt, pytorch, transformer; language differs: Python → C++

  4. codertimo/BERT-pytorch

    Google AI 2018 BERT pytorch implementation

    Python★ 6.5kApache-2.0GitHub ↗

    Why this match

    topics nlp, pytorch, transformer

  5. allenai/allennlp

    An open-source NLP research library, built on PyTorch.

    Python★ 11.9kApache-2.0archivedGitHub ↗

    Why this match

    topics deep-learning, nlp, pytorch

  6. NLP-LOVE/ML-NLP

    此项目是机器学习(Machine Learning)、深度学习(Deep Learning)、NLP面试中常考到的知识点和代码实现,也是作为一个算法工程师必会的理论基础知识。

    Jupyter Notebook★ 17.8kGitHub ↗

    Why this match

    topics deep-learning, nlp; language differs: Python → Jupyter Notebook

  7. lukasmasuch/best-of-ml-python

    🏆 A ranked list of awesome machine learning Python libraries. Updated weekly.

    ★ 23.9kCC-BY-SA-4.0GitHub ↗

    Why this match

    topics deep-learning, gpt, nlp; license differs: Apache-2.0 → CC-BY-SA-4.0

  8. SYSTRAN/faster-whisper

    Faster Whisper transcription with CTranslate2

    Python★ 26.5kMITGitHub ↗

    Why this match

    topics deep-learning, inference, transformer; license differs: Apache-2.0 → MIT