discover · compare · collections · requirements · contribute · feed · watching · stats · help with your tokens
cactus-compute/needle
Automation foundation model for tiny devices: 2-bit, 8-29 MB, tool calls, ASR, structured extraction and embeddings on phones, wearables, smart homes, robots, cars and microcontrollers.
History and source changes · Reports and owner responses · Compare
Similar
- google-ai-edge/LiteRT-LM
LiteRT-LM is Google's production-ready, high-performance, open-source inference framework for deploying Large Language Models on edge devices.
Why this match
topics edge-ai, on-device-ai; language differs: Python → C++
- guardrails-ai/guardrails
Adding guardrails to large language models.
Why this match
topics foundation-model, llm
- alexeyw/knotwork
An AI agent you build, not just prompt. Local-first Android agent with on-device inference (LiteRT-LM), pipelines you assemble yourself, MCP tool calling, and your confirmation before any risky action.
Why this match
topics edge-ai, llm, on-device-ai; language differs: Python → Kotlin
- sigoden/aichat
All-in-one LLM CLI tool featuring Shell Assistant, Chat-REPL, RAG, AI Tools & Agents, with access to OpenAI, Claude, Gemini, Ollama, Groq, and more.
Why this match
topics function-calling, llm; language differs: Python → Rust
- JoakimCarlsson/ai
A Go toolkit for building AI agents and applications across multiple providers. Unified LLM client, agent framework with handoffs, tool calling, streaming, structured output, MCP integration, and cost tracking.
Why this match
topics llm, tool-calling; language differs: Python → Go; license differs: Apache-2.0 → MIT
- evgenii-engineer/openLight
Lightweight AI agent runtime for homelabs, built around deterministic skills and local LLMs.
Why this match
topics edge-ai, llm; language differs: Python → Go; license differs: Apache-2.0 → MIT
- Arthur-Ficial/apfel
The free AI already on your Mac. CLI tool, OpenAI-compatible server, and interactive chat — all on-device via Apple Intelligence. No API keys, no cloud, no downloads.
Why this match
topics llm, tool-calling; language differs: Python → Swift; license differs: Apache-2.0 → MIT
- ComposioHQ/composio
Composio powers 1000+ toolkits, tool search, context management, authentication, and a sandboxed workbench to help you build AI agents that turn intent into action.
Why this match
topics function-calling, llm; language differs: Python → TypeScript; license differs: Apache-2.0 → MIT