JustVugg/colibri · 8h
colibri is a C inference engine that runs very large open mixture-of-experts models on the machine you already have.
It makes models of this size usable on hardware people already own, and keeps the engine small enough that anyone can measure and speed it up. It is written in pure C, with one file per model family, and needs no GPU.
GitHub · A hierarchical inference engine for frontier MoE models