localai-backend/llama-cpp (local-ai)

Search

Install

Install this package:

emerge -a localai-backend/llama-cpp

Package Information

Description:
LocalAI text-generation backend (llama.cpp gRPC server)

Versions

Version EAPI Keywords Slot
5.0.1 8 ~amd64

Metadata

Maintainers

Upstream

Raw Metadata XML
<pkgmetadata>
	<maintainer type="person">
		<email>plamen@ipnmod.org</email>
		<name>Plamen K. Kosseff</name>
	</maintainer>
	<use>
		<flag name="native">Let the bundled ggml library auto-detect the build host's CPU features (-march=native) instead of relying on CFLAGS</flag>
		<flag name="openblas">CPU BLAS acceleration via <pkg>sci-libs/openblas</pkg></flag>
		<flag name="rocm">GPU acceleration on AMD via ROCm/HIP</flag>
		<flag name="vulkan">GPU acceleration via Vulkan</flag>
	</use>
	<upstream>
		<remote-id type="github">mudler/LocalAI</remote-id>
	</upstream>
</pkgmetadata>

Lint Warnings

USE Flags

Manage flags for this package: euse -i <flag> -p localai-backend/llama-cpp | euse -E <flag> -p localai-backend/llama-cpp | euse -D <flag> -p localai-backend/llama-cpp

Flag Description 5.0.1
test ⚠️ ✓

Manifest

Type File Size Versions
DIST llama.cpp-78e05298f0d68abff41d08d79fa7469264b2aff0.tar.gz 39039448 bytes 5.0.1
Unmatched Entries
Type File Size
DIST localai-5.0.1.tar.gz 65986154 bytes
EBUILD llama-cpp-5.0.1.ebuild 3283 bytes
MISC metadata.xml 697 bytes