G
YouTube TikTok Games
Skip to content
#

colibri

Here are 40 public repositories matching this topic...

Lightweight C inference engine for large mixture-of-experts models, streaming routed experts from NVMe and caching them across RAM and VRAM. Includes adaptive expert placement, CPU and optional GPU backends, KV reuse, a CLI, OpenAI-compatible serving, and a web dashboard.

  • Updated Aug 7, 2026
  • C

Add this topic to your repo

To associate your repository with the colibri topic, visit your repo's landing page and select "manage topics."

Learn more