brainstate

drumih/turbo-fieldfare

Gemma 4 26B-A4B inference in ~2 GB of RAM on any M-series MacBook

Swift★ 7.1kApache-2.0GitHub ↗

History and source changes · Reports and owner responses · Compare

Similar

  1. google-ai-edge/LiteRT-LM

    LiteRT-LM is Google's production-ready, high-performance, open-source inference framework for deploying Large Language Models on edge devices.

    C++★ 6.8kApache-2.0GitHub ↗

    Why this match

    topics on-device-ai, on-device-llm; language differs: Swift → C++

  2. qualcomm/GenieX

    Run frontier LLMs and VLMs locally on Qualcomm devices across NPU, GPU, and CPU with a few lines of code

    Go★ 8.5kBSD-3-ClauseGitHub ↗

    Why this match

    topics gemma4, llm, local-ai; language differs: Swift → Go; license differs: Apache-2.0 → BSD-3-Clause

  3. jundot/omlx

    LLM inference server with continuous batching & SSD caching for Apple Silicon — managed from the macOS menu bar

    Python★ 23.3kApache-2.0GitHub ↗

    Why this match

    topics apple-silicon, llm, macos; language differs: Swift → Python

  4. mistralai/mistral-inference

    Official inference library for Mistral models

    Jupyter Notebook★ 10.8kApache-2.0archivedGitHub ↗

    Why this match

    topics llm, llm-inference; language differs: Swift → Jupyter Notebook

  5. Beingpax/VoiceInk

    The best open-source alternative to Superwhisper & Wispr Flow. Voice-to-text app for macOS with no subscription

    Swift★ 7.0kGitHub ↗

    Why this match

    topics macos, swift

  6. autonomous-ai/Personal-AI-Computer

    Open-source AI computer designs, from desktop workstations to 8-GPU servers.

    ★ 1.6kMITGitHub ↗

    Why this match

    topics local-ai; license differs: Apache-2.0 → MIT

  7. Arthur-Ficial/apfel

    The free AI already on your Mac. CLI tool, OpenAI-compatible server, and interactive chat — all on-device via Apple Intelligence. No API keys, no cloud, no downloads.

    Swift★ 6.5kMITGitHub ↗

    Why this match

    topics apple-silicon, llm, macos; license differs: Apache-2.0 → MIT

  8. MochiDiffusion/MochiDiffusion

    Run Stable Diffusion on Mac natively

    Swift★ 8.0kGPL-3.0GitHub ↗

    Why this match

    topics apple-silicon, macos, swift; license differs: Apache-2.0 → GPL-3.0