localai-backend/ik-llama-cpp (local-ai)

Search

Install

Install this package:

emerge -a localai-backend/ik-llama-cpp

Package Information

Description:
LocalAI text-generation backend (ik_llama.cpp gRPC server)

Versions

Version EAPI Keywords Slot
4.11.0 8 ~amd64

Metadata

Maintainers

Upstream

Raw Metadata XML
<pkgmetadata>
	<maintainer type="person">
		<email>plamen@ipnmod.org</email>
		<name>Plamen K. Kosseff</name>
	</maintainer>
	<use>
		<flag name="native">Let the bundled ggml library auto-detect the build host's CPU features (-march=native) instead of relying on CFLAGS</flag>
		<flag name="openblas">CPU BLAS acceleration via <pkg>sci-libs/openblas</pkg></flag>
		<flag name="rocm">GPU acceleration on AMD via ROCm/HIP</flag>
		<flag name="vulkan">GPU acceleration via Vulkan</flag>
	</use>
	<upstream>
		<remote-id type="github">mudler/LocalAI</remote-id>
		<remote-id type="github">ikawrakow/ik_llama.cpp</remote-id>
	</upstream>
</pkgmetadata>

Lint Warnings

Manifest

Type File Size Versions
DIST ik_llama.cpp-d9e286846d6f8232db48ec5c111a4ea3aea675ef.tar.gz 34954267 bytes 4.11.0
Unmatched Entries
Type File Size
DIST localai-4.11.0.tar.gz 27596319 bytes
EBUILD ik-llama-cpp-4.11.0.ebuild 3112 bytes
MISC metadata.xml 759 bytes