Gentoo Packages

Search

Install

Install this package:

emerge -a sci-ml/colibri

Package Information

Description:

Colibri runs GLM-5.2 (744B-parameter MoE) on consumer hardware with as little as 25GB RAM. Pure C engine with zero runtime dependencies, streaming experts from disk with an LRU cache. Supports MLA attention, MTP speculative decoding, and optional CUDA GPU offloading.

Homepage:

https://github.com/JustVugg/colibri

License:

Apache-2.0

Versions

Metadata

Description

• Colibri runs GLM-5.2 (744B-parameter MoE) on consumer hardware with as little as 25GB RAM. Pure C engine with zero runtime dependencies, streaming experts from disk with an LRU cache. Supports MLA attention, MTP speculative decoding, and optional CUDA GPU offloading.

Maintainers

• Benny Powers (web@bennypowers.com) - Type: person

Upstream

• Remote IDs:
  • github: JustVugg/colibri

<pkgmetadata>
	<maintainer type="person">
		<email>web@bennypowers.com</email>
		<name>Benny Powers</name>
	</maintainer>
	<longdescription lang="en">
		Colibri runs GLM-5.2 (744B-parameter MoE) on consumer hardware with
		as little as 25GB RAM. Pure C engine with zero runtime dependencies,
		streaming experts from disk with an LRU cache. Supports MLA attention,
		MTP speculative decoding, and optional CUDA GPU offloading.
	</longdescription>
	<use>
		<flag name="bench">Install dependencies for quality benchmarks
			(MMLU, HellaSwag, ARC)</flag>
		<flag name="cuda">Build with NVIDIA CUDA GPU offloading for
			resident expert tensors</flag>
		<flag name="python">Install the coli Python CLI for model management,
			chat, serving, and weight conversion</flag>
		<flag name="rocm">Build with AMD ROCm/HIP GPU offloading for
			resident expert tensors</flag>
	</use>
	<upstream>
		<remote-id type="github">JustVugg/colibri</remote-id>
	</upstream>
</pkgmetadata>

Lint Warnings

• [Error] Manifest entry for unused DIST file 'colibri-1.1.0.tar.gz'
• [Error] Manifest entry for unused DIST file 'colibri-1.1.1.tar.gz'
• [Error] Repository is missing a repo-name in metadata/layout.conf or profiles/repo_name
• [Warning] Missing md5-cache for ebuild colibri-9999
• [Warning] Missing md5-cache for ebuild colibri-1.1.1
• [Warning] Missing md5-cache for ebuild colibri-1.1.0-r1
• [Warning] Missing md5-cache for ebuild colibri-1.1.0

USE Flags

Manage flags for this package: euse -i <flag> -p sci-ml/colibri | euse -E <flag> -p sci-ml/colibri | euse -D <flag> -p sci-ml/colibri

Manifest