Gentoo Packages

Search

Install

Install this package:

emerge -a localai-backend/bonsai

Package Information

Description:

LocalAI text-generation backend for 1-bit/ternary models (Bonsai fork of llama.cpp)

Versions

Metadata

Maintainers

• Plamen K. Kosseff (plamen@ipnmod.org) - Type: person

Upstream

• Remote IDs:
  • github: mudler/LocalAI

<pkgmetadata>
	<maintainer type="person">
		<email>plamen@ipnmod.org</email>
		<name>Plamen K. Kosseff</name>
	</maintainer>
	<use>
		<flag name="native">Let the bundled ggml library auto-detect the build host's CPU features (-march=native) instead of relying on CFLAGS</flag>
		<flag name="openblas">CPU BLAS acceleration via <pkg>sci-libs/openblas</pkg></flag>
		<flag name="rocm">GPU acceleration on AMD via ROCm/HIP</flag>
		<flag name="vulkan">GPU acceleration via Vulkan</flag>
	</use>
	<upstream>
		<remote-id type="github">mudler/LocalAI</remote-id>
	</upstream>
</pkgmetadata>

Lint Warnings

• [Warning] Ebuild 4.11.0 has a line exceeding 80 positions on line 37.
• [Warning] Ebuild 4.11.0 has a line exceeding 80 positions on line 40.
• [Warning] USE flag 'test' in ebuild 4.11.0 is not documented in metadata.xml
• [Error] Ebuild 4.11.0 does not specify LICENSE
• [Warning] Ebuild 4.11.0 is missing HOMEPAGE
• [Warning] Ebuild 4.11.0 is missing the SLOT variable.
• [Error] Manifest entry for unused DIST file 'PrismML-llama.cpp-adfffbe41b2cabcd51fff326ab045662265062bb.tar.gz'
• [Error] Manifest entry for unused DIST file 'localai-4.11.0.tar.gz'
• [Error] Repository is missing a repo-name in metadata/layout.conf or profiles/repo_name
• [Notice] Package has only unstable keywords for arch(es): [ amd64 ], all versions are unstable: [ 4.11.0 ]
• Note: category 'localai-backend' is not in the main gentoo categories list

USE Flags

Manage flags for this package: euse -i <flag> -p localai-backend/bonsai | euse -E <flag> -p localai-backend/bonsai | euse -D <flag> -p localai-backend/bonsai

Manifest