brainstate

discover · compare · collections · requirements · contribute · feed · watching · stats · help with your tokens

google-ai-edge/LiteRT-LM

LiteRT-LM is Google's production-ready, high-performance, open-source inference framework for deploying Large Language Models on edge devices.

C++★ 6.8kApache-2.0GitHub ↗

History and source changes · Reports and owner responses · Compare

Similar

  1. cactus-compute/needle

    Automation foundation model for tiny devices: 2-bit, 8-29 MB, tool calls, ASR, structured extraction and embeddings on phones, wearables, smart homes, robots, cars and microcontrollers.

    Python★ 14.5kApache-2.0GitHub ↗

    Why this match

    topics edge-ai, on-device-ai; language differs: C++ → Python

  2. drumih/turbo-fieldfare

    Gemma 4 26B-A4B inference in ~2 GB of RAM on any M-series MacBook

    Swift★ 7.1kApache-2.0GitHub ↗

    Why this match

    topics on-device-ai, on-device-llm; language differs: C++ → Swift

  3. alexeyw/knotwork

    An AI agent you build, not just prompt. Local-first Android agent with on-device inference (LiteRT-LM), pipelines you assemble yourself, MCP tool calling, and your confirmation before any risky action.

    Kotlin★ 43Apache-2.0GitHub ↗

    Why this match

    topics edge-ai, on-device-ai; language differs: C++ → Kotlin

  4. wenet-ec/edge-core

    Self-hostable Linux and edge fleet-management platform — operate machines behind NAT and firewalls with a WireGuard mesh, remote commands, SSH proxying, Prometheus metrics, events, and MCP over one API.

    Elixir★ 25GitHub ↗

    Why this match

    topics edge-ai; language differs: C++ → Elixir

  5. beclab/Olares

    Open-Source Personal Cloud OS for Always-On Agents

    Go★ 5.3kAGPL-3.0GitHub ↗

    Why this match

    topics edge-ai; language differs: C++ → Go; license differs: Apache-2.0 → AGPL-3.0

  6. evgenii-engineer/openLight

    Lightweight AI agent runtime for homelabs, built around deterministic skills and local LLMs.

    Go★ 39MITGitHub ↗

    Why this match

    topics edge-ai; language differs: C++ → Go; license differs: Apache-2.0 → MIT

  7. ultralytics/yolov3

    PyTorch implementation of YOLOv3, YOLOv3-SPP, and YOLOv3-tiny for real-time object detection with training, validation, inference, and multi-format export.

    Python★ 10.6kAGPL-3.0GitHub ↗

    Why this match

    topics edge-ai; language differs: C++ → Python; license differs: Apache-2.0 → AGPL-3.0

  8. nats-io/nats-server

    High-Performance server for NATS.io, the cloud and edge native messaging system.

    Go★ 21.0kApache-2.0GitHub ↗

    Why this match

    topics edge-ai; language differs: C++ → Go