# colibri

JustVugg released colibri, an open-source inference engine written in pure C with one file per model family and no GPU required. A mixture-of-experts model uses only a small part of itself for each token, so colibri keeps that part in RAM and reads the remaining experts from disk on demand. In the official example, the 744B-parameter int4 GLM-5.2 MoE model is ready in 32 seconds on CPU with 9.9 GB resident; the minimum is 8 GB of RAM, and the smallest model needs 22 GB of disk.

JustVugg released colibri, an open-source inference engine written in pure C with one file per model family and no GPU required. A mixture-of-experts model uses only a small part of itself for each token, so colibri keeps that part in RAM and reads the remaining experts from disk on demand. In the official example, the 744B-parameter int4 GLM-5.2 MoE model is ready in 32 seconds on CPU with 9.9 GB resident; the minimum is 8 GB of RAM, and the smallest model needs 22 GB of disk.