brainstate

jundot/omlx

LLM inference server with continuous batching & SSD caching for Apple Silicon — managed from the macOS menu bar

Python★ 23.3kApache-2.0GitHub ↗

History and source changes · Reports and owner responses · Compare

Similar

  1. ml-explore/mlx

    MLX: An array framework for Apple silicon

    C++★ 29.1kMITGitHub ↗

    Why this match

    topics mlx; language differs: Python → C++; license differs: Apache-2.0 → MIT

  2. ml-explore/mlx-examples

    Examples in the MLX framework

    Python★ 9.1kMITGitHub ↗

    Why this match

    topics mlx; license differs: Apache-2.0 → MIT

  3. ml-explore/mlx-lm

    Run LLMs with MLX

    Python★ 7.5kMITGitHub ↗

    Why this match

    topics mlx; license differs: Apache-2.0 → MIT

  4. Neywa-Labs/mlx-audio

    A text-to-speech (TTS), speech-to-text (STT) and speech-to-speech (STS) library built on Apple's MLX framework, providing efficient speech analysis on Apple Silicon.

    Python★ 8.2kMITGitHub ↗

    Why this match

    topics apple-silicon, mlx; license differs: Apache-2.0 → MIT

  5. mizorewww/laya-mlx

    Native MLX runtime for Laya typed decision models — 7–14 ms short decisions on M3 Max. No text generation, PyTorch, or cloud API.

    Python★ 7.1kApache-2.0GitHub ↗

    Why this match

    topics apple-silicon, mlx

  6. momenbasel/awesome-mac-mini-homeserver

    260+ curated tools, guides, and projects for turning an Apple Silicon Mac mini into a 24/7 agentic AI home server. Ollama, Claude Code, Jellyfin, Vaultwarden, Home Assistant, and more - with one-command installers.

    Shell★ 29GitHub ↗

    Why this match

    topics apple-silicon, macos, mlx; language differs: Python → Shell

  7. AlexsJones/llmfit

    Hundreds of models & providers. One command to find what runs on your hardware.

    Rust★ 38.6kMITGitHub ↗

    Why this match

    topics llm, mlx; language differs: Python → Rust; license differs: Apache-2.0 → MIT

  8. Arthur-Ficial/apfel

    The free AI already on your Mac. CLI tool, OpenAI-compatible server, and interactive chat — all on-device via Apple Intelligence. No API keys, no cloud, no downloads.

    Swift★ 6.5kMITGitHub ↗

    Why this match

    topics apple-silicon, llm, macos; language differs: Python → Swift; license differs: Apache-2.0 → MIT