brainstate

FareedKhan-dev/kimi-k3-in-c

A 2.78-trillion-parameter Kimi K3 running inference on a single CPU in 8.24 GB of RAM. Portable C99: no BLAS, no framework, no GPU.

C★ 10.0kApache-2.0GitHub ↗

History and source changes · Reports and owner responses · Compare

Similar

  1. bitsandbytes-foundation/bitsandbytes

    Accessible large language models via k-bit quantization for PyTorch.

    Python★ 8.5kMITGitHub ↗

    Why this match

    topics llm, machine-learning, quantization; language differs: C → Python; license differs: Apache-2.0 → MIT

  2. SYSTRAN/faster-whisper

    Faster Whisper transcription with CTranslate2

    Python★ 26.5kMITGitHub ↗

    Why this match

    topics deep-learning, quantization, transformer; language differs: C → Python; license differs: Apache-2.0 → MIT

  3. GeeeekExplorer/nano-vllm

    Nano vLLM

    Python★ 16.3kMITGitHub ↗

    Why this match

    topics deep-learning, llm, transformer; language differs: C → Python; license differs: Apache-2.0 → MIT

  4. Lightning-AI/litgpt

    20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale.

    Python★ 13.7kApache-2.0GitHub ↗

    Why this match

    topics deep-learning, llm, llm-inference; language differs: C → Python

  5. mistralai/mistral-inference

    Official inference library for Mistral models

    Jupyter Notebook★ 10.8kApache-2.0archivedGitHub ↗

    Why this match

    topics llm, llm-inference; language differs: C → Jupyter Notebook

  6. google/trax

    Trax — Deep Learning with Clear Code and Speed

    Python★ 8.3kApache-2.0archivedGitHub ↗

    Why this match

    topics deep-learning, machine-learning, transformer; language differs: C → Python

  7. mrdbourke/zero-to-mastery-ml

    All course materials for the Zero to Mastery Machine Learning and Data Science course.

    Jupyter Notebook★ 7.5kGitHub ↗

    Why this match

    topics deep-learning, machine-learning; language differs: C → Jupyter Notebook

  8. NLP-LOVE/ML-NLP

    此项目是机器学习(Machine Learning)、深度学习(Deep Learning)、NLP面试中常考到的知识点和代码实现,也是作为一个算法工程师必会的理论基础知识。

    Jupyter Notebook★ 17.8kGitHub ↗

    Why this match

    topics deep-learning, machine-learning; language differs: C → Jupyter Notebook