Run large AI models across your computers and servers. Powered by Colibri. Pure C.
-
Updated
Nov 13, 2026 - C
Run large AI models across your computers and servers. Powered by Colibri. Pure C.
Reset your Colibri License in a WordPress Website. Impossible to do in the UI without this plugin. This was supplied to me by Colibri's support.
Alternative VK micro-messenger/music-player for Windows 10 Mobile. RU zone preferred.
Faster expert loading for Mixture-of-Experts LLM inference on small machines: parallel miss loading and bit-exact expert-major prefill for colibri (Qwen3-Coder-30B). TTFT 376 s -> 30 s.
Distributed blade & backplane architecture for frontier-scale MoE models. 4–6x RK3588 ARM nodes, 12–18 NVMe channels, ~16–24 GB/s storage BW.
Dashboard for on-train data visualization in 3D - working PoC for Deutsche Bahn Hackathon 2017
Running local models
Experimental low-memory LLM inference: AirLLM readers, Transformers forward and native Colibri cache policy. Active WIP; no production or speed guarantees.
Lightweight C inference engine for large mixture-of-experts models, streaming routed experts from NVMe and caching them across RAM and VRAM. Includes adaptive expert placement, CPU and optional GPU backends, KV reuse, a CLI, OpenAI-compatible serving, and a web dashboard.
To associate your repository with the colibri topic, visit your repo's landing page and select "manage topics."