Gentoo Packages

Search

Install

Install this package:

emerge -a sci-misc/llama-cpp

Package Information

Description:: Port of Facebook's LLaMA model in C/C++
Homepage:: https://github.com/ggml-org/llama.cpp
License:: MIT

Versions

Version	EAPI	Keywords
9999	8	~amd64
0.4.1	8	~amd64
0.4.0	8	~amd64

Metadata

Maintainers

Paul Zander (negril.nx+gentoo@gmail.com) - Type: person
Stefan Sydow (stefan@sydow.email) - Type: person
Gilles Dartiguelongue (gilles.dartiguelongue@esiee.org) - Type: person

Upstream

Remote IDs:
- github: ggml-org/llama.cpp

Raw Metadata XML

<pkgmetadata>
	<maintainer type="person">
		<email>negril.nx+gentoo@gmail.com</email>
		<name>Paul Zander</name>
	</maintainer>
	<maintainer type="person">
		<email>stefan@sydow.email</email>
		<name>Stefan Sydow</name>
	</maintainer>
	<maintainer type="person">
		<email>gilles.dartiguelongue@esiee.org</email>
		<name>Gilles Dartiguelongue</name>
	</maintainer>
	<use>
		<flag name="blis">Build a BLIS backend</flag>
		<flag name="flexiblas">Build a FlexiBLAS backend</flag>
		<flag name="openblas">Build an OpenBLAS backend</flag>
		<flag name="opencl">Build an OpenCL backend, so far only works on Adreno and Intel GPUs</flag>
		<flag name="openssl">Use openssl to support HTTPS</flag>
		<flag name="rocm">Build a HIP (ROCm) backend</flag>
	</use>
	<upstream>
		<remote-id type="github">ggml-org/llama.cpp</remote-id>
	</upstream>
</pkgmetadata>

Lint Warnings

[Warning] Ebuild 9999 has a line exceeding 80 positions on line 31.
[Warning] Ebuild 9999 has a line exceeding 80 positions on line 37.
[Warning] Ebuild 9999 has a line exceeding 80 positions on line 42.
[Warning] Ebuild 9999 has a line exceeding 80 positions on line 47.
[Warning] Ebuild 9999 has a line exceeding 80 positions on line 73.
[Warning] Ebuild 9999 has a line exceeding 80 positions on line 126.
[Warning] Ebuild 9999 has a line exceeding 80 positions on line 144.
[Warning] Ebuild 9999 has a tab character outside of indentation on line 172.
[Warning] Ebuild 0.4.1 has a line exceeding 80 positions on line 31.
[Warning] Ebuild 0.4.1 has a line exceeding 80 positions on line 37.
[Warning] Ebuild 0.4.1 has a line exceeding 80 positions on line 42.
[Warning] Ebuild 0.4.1 has a line exceeding 80 positions on line 47.
[Warning] Ebuild 0.4.1 has a line exceeding 80 positions on line 73.
[Warning] Ebuild 0.4.1 has a line exceeding 80 positions on line 126.
[Warning] Ebuild 0.4.1 has a line exceeding 80 positions on line 144.
[Warning] Ebuild 0.4.1 has a tab character outside of indentation on line 172.
[Warning] Ebuild 0.4.0 has a line exceeding 80 positions on line 30.
[Warning] Ebuild 0.4.0 has a line exceeding 80 positions on line 36.
[Warning] Ebuild 0.4.0 has a line exceeding 80 positions on line 41.
[Warning] Ebuild 0.4.0 has a line exceeding 80 positions on line 43.
[Warning] Ebuild 0.4.0 has a line exceeding 80 positions on line 44.
[Warning] Ebuild 0.4.0 has a line exceeding 80 positions on line 68.
[Warning] Ebuild 0.4.0 has a line exceeding 80 positions on line 117.
[Warning] Ebuild 0.4.0 has a line exceeding 80 positions on line 135.
[Warning] Ebuild 0.4.0 has a tab character outside of indentation on line 162.
[Warning] USE flag '(' in ebuild 9999 is not documented in metadata.xml
[Warning] USE flag '"(' in ebuild 9999 is not documented in metadata.xml
[Warning] USE flag 'amx_bf16' in ebuild 9999 is not documented in metadata.xml
[Warning] USE flag 'amx_int8' in ebuild 9999 is not documented in metadata.xml
[Warning] USE flag 'amx_tile' in ebuild 9999 is not documented in metadata.xml
[Warning] USE flag 'avx' in ebuild 9999 is not documented in metadata.xml
[Warning] USE flag 'avx2' in ebuild 9999 is not documented in metadata.xml
[Warning] USE flag 'avx512_bf16' in ebuild 9999 is not documented in metadata.xml
[Warning] USE flag 'avx512_vnni' in ebuild 9999 is not documented in metadata.xml
[Warning] USE flag 'avx512f' in ebuild 9999 is not documented in metadata.xml
[Warning] USE flag 'avx512vbmi' in ebuild 9999 is not documented in metadata.xml
[Warning] USE flag 'avx_vnni' in ebuild 9999 is not documented in metadata.xml
[Warning] USE flag 'bmi2' in ebuild 9999 is not documented in metadata.xml
[Warning] USE flag 'f16c' in ebuild 9999 is not documented in metadata.xml
[Warning] USE flag 'fma3' in ebuild 9999 is not documented in metadata.xml
[Warning] USE flag 'sse4_2' in ebuild 9999 is not documented in metadata.xml
[Warning] USE flag ')"' in ebuild 9999 is not documented in metadata.xml
[Warning] USE flag ')' in ebuild 9999 is not documented in metadata.xml
[Warning] USE flag 'cuda' in ebuild 9999 is not documented in metadata.xml
[Warning] USE flag 'openmp' in ebuild 9999 is not documented in metadata.xml
[Warning] USE flag 'vulkan' in ebuild 9999 is not documented in metadata.xml
[Warning] USE flag 'curl' in ebuild 9999 is not documented in metadata.xml
[Warning] USE flag 'examples' in ebuild 9999 is not documented in metadata.xml
[Warning] USE flag 'test' in ebuild 9999 is not documented in metadata.xml
[Warning] USE flag '(' in ebuild 0.4.1 is not documented in metadata.xml
[Warning] USE flag '"(' in ebuild 0.4.1 is not documented in metadata.xml
[Warning] USE flag 'amx_bf16' in ebuild 0.4.1 is not documented in metadata.xml
[Warning] USE flag 'amx_int8' in ebuild 0.4.1 is not documented in metadata.xml
[Warning] USE flag 'amx_tile' in ebuild 0.4.1 is not documented in metadata.xml
[Warning] USE flag 'avx' in ebuild 0.4.1 is not documented in metadata.xml
[Warning] USE flag 'avx2' in ebuild 0.4.1 is not documented in metadata.xml
[Warning] USE flag 'avx512_bf16' in ebuild 0.4.1 is not documented in metadata.xml
[Warning] USE flag 'avx512_vnni' in ebuild 0.4.1 is not documented in metadata.xml
[Warning] USE flag 'avx512f' in ebuild 0.4.1 is not documented in metadata.xml
[Warning] USE flag 'avx512vbmi' in ebuild 0.4.1 is not documented in metadata.xml
[Warning] USE flag 'avx_vnni' in ebuild 0.4.1 is not documented in metadata.xml
[Warning] USE flag 'bmi2' in ebuild 0.4.1 is not documented in metadata.xml
[Warning] USE flag 'f16c' in ebuild 0.4.1 is not documented in metadata.xml
[Warning] USE flag 'fma3' in ebuild 0.4.1 is not documented in metadata.xml
[Warning] USE flag 'sse4_2' in ebuild 0.4.1 is not documented in metadata.xml
[Warning] USE flag ')"' in ebuild 0.4.1 is not documented in metadata.xml
[Warning] USE flag ')' in ebuild 0.4.1 is not documented in metadata.xml
[Warning] USE flag 'cuda' in ebuild 0.4.1 is not documented in metadata.xml
[Warning] USE flag 'openmp' in ebuild 0.4.1 is not documented in metadata.xml
[Warning] USE flag 'vulkan' in ebuild 0.4.1 is not documented in metadata.xml
[Warning] USE flag 'curl' in ebuild 0.4.1 is not documented in metadata.xml
[Warning] USE flag 'examples' in ebuild 0.4.1 is not documented in metadata.xml
[Warning] USE flag 'test' in ebuild 0.4.1 is not documented in metadata.xml
[Warning] USE flag '(' in ebuild 0.4.0 is not documented in metadata.xml
[Warning] USE flag '"(' in ebuild 0.4.0 is not documented in metadata.xml
[Warning] USE flag 'amx_bf16' in ebuild 0.4.0 is not documented in metadata.xml
[Warning] USE flag 'amx_int8' in ebuild 0.4.0 is not documented in metadata.xml
[Warning] USE flag 'amx_tile' in ebuild 0.4.0 is not documented in metadata.xml
[Warning] USE flag 'avx' in ebuild 0.4.0 is not documented in metadata.xml
[Warning] USE flag 'avx2' in ebuild 0.4.0 is not documented in metadata.xml
[Warning] USE flag 'avx512_bf16' in ebuild 0.4.0 is not documented in metadata.xml
[Warning] USE flag 'avx512_vnni' in ebuild 0.4.0 is not documented in metadata.xml
[Warning] USE flag 'avx512f' in ebuild 0.4.0 is not documented in metadata.xml
[Warning] USE flag 'avx512vbmi' in ebuild 0.4.0 is not documented in metadata.xml
[Warning] USE flag 'avx_vnni' in ebuild 0.4.0 is not documented in metadata.xml
[Warning] USE flag 'bmi2' in ebuild 0.4.0 is not documented in metadata.xml
[Warning] USE flag 'f16c' in ebuild 0.4.0 is not documented in metadata.xml
[Warning] USE flag 'fma3' in ebuild 0.4.0 is not documented in metadata.xml
[Warning] USE flag 'sse4_2' in ebuild 0.4.0 is not documented in metadata.xml
[Warning] USE flag ')"' in ebuild 0.4.0 is not documented in metadata.xml
[Warning] USE flag ')' in ebuild 0.4.0 is not documented in metadata.xml
[Warning] USE flag 'cuda' in ebuild 0.4.0 is not documented in metadata.xml
[Warning] USE flag 'curl' in ebuild 0.4.0 is not documented in metadata.xml
[Warning] USE flag 'examples' in ebuild 0.4.0 is not documented in metadata.xml
[Warning] USE flag 'openmp' in ebuild 0.4.0 is not documented in metadata.xml
[Warning] USE flag 'vulkan' in ebuild 0.4.0 is not documented in metadata.xml
[Error] Manifest entry for unused DIST file 'ggml-org_models_tinyllamas_stories15M-q4_0-99dd1a73db5a37100bd4ae633f4cfce6560e1567.gguf'
[Error] Manifest entry for unused DIST file 'llama-b10809-ui.tar.gz'
[Error] Manifest entry for unused DIST file 'llama-b10964-ui.tar.gz'
[Error] Manifest entry for unused DIST file 'llama-cpp-0.4.0.tar.gz'
[Error] Manifest entry for unused DIST file 'llama-cpp-0.4.1.tar.gz'
[Error] Repository is missing a repo-name in metadata/layout.conf or profiles/repo_name
[Notice] Package has only unstable keywords for arch(es): [ amd64 ], all versions are unstable: [ 0.4.0, 0.4.1 ]
[Warning] Ebuild 9999 uses a regular USE flag 'amx_bf16' containing an underscore. Underscores are reserved for USE_EXPAND flags.
[Warning] Ebuild 9999 uses a regular USE flag 'amx_int8' containing an underscore. Underscores are reserved for USE_EXPAND flags.
[Warning] Ebuild 9999 uses a regular USE flag 'amx_tile' containing an underscore. Underscores are reserved for USE_EXPAND flags.
[Warning] Ebuild 9999 uses a regular USE flag 'avx512_bf16' containing an underscore. Underscores are reserved for USE_EXPAND flags.
[Warning] Ebuild 9999 uses a regular USE flag 'avx512_vnni' containing an underscore. Underscores are reserved for USE_EXPAND flags.
[Warning] Ebuild 9999 uses a regular USE flag 'avx_vnni' containing an underscore. Underscores are reserved for USE_EXPAND flags.
[Warning] Ebuild 9999 uses a regular USE flag 'sse4_2' containing an underscore. Underscores are reserved for USE_EXPAND flags.
[Warning] Ebuild 0.4.1 uses a regular USE flag 'amx_bf16' containing an underscore. Underscores are reserved for USE_EXPAND flags.
[Warning] Ebuild 0.4.1 uses a regular USE flag 'amx_int8' containing an underscore. Underscores are reserved for USE_EXPAND flags.
[Warning] Ebuild 0.4.1 uses a regular USE flag 'amx_tile' containing an underscore. Underscores are reserved for USE_EXPAND flags.
[Warning] Ebuild 0.4.1 uses a regular USE flag 'avx512_bf16' containing an underscore. Underscores are reserved for USE_EXPAND flags.
[Warning] Ebuild 0.4.1 uses a regular USE flag 'avx512_vnni' containing an underscore. Underscores are reserved for USE_EXPAND flags.
[Warning] Ebuild 0.4.1 uses a regular USE flag 'avx_vnni' containing an underscore. Underscores are reserved for USE_EXPAND flags.
[Warning] Ebuild 0.4.1 uses a regular USE flag 'sse4_2' containing an underscore. Underscores are reserved for USE_EXPAND flags.
[Warning] Ebuild 0.4.0 uses a regular USE flag 'amx_bf16' containing an underscore. Underscores are reserved for USE_EXPAND flags.
[Warning] Ebuild 0.4.0 uses a regular USE flag 'amx_int8' containing an underscore. Underscores are reserved for USE_EXPAND flags.
[Warning] Ebuild 0.4.0 uses a regular USE flag 'amx_tile' containing an underscore. Underscores are reserved for USE_EXPAND flags.
[Warning] Ebuild 0.4.0 uses a regular USE flag 'avx512_bf16' containing an underscore. Underscores are reserved for USE_EXPAND flags.
[Warning] Ebuild 0.4.0 uses a regular USE flag 'avx512_vnni' containing an underscore. Underscores are reserved for USE_EXPAND flags.
[Warning] Ebuild 0.4.0 uses a regular USE flag 'avx_vnni' containing an underscore. Underscores are reserved for USE_EXPAND flags.
[Warning] Ebuild 0.4.0 uses a regular USE flag 'sse4_2' containing an underscore. Underscores are reserved for USE_EXPAND flags.
[Warning] Ebuild 9999 uses hierarchical versioned USE flags (avx and avx2). Flat, explicitly versioned flags (e.g. avx2 only) are recommended.
[Warning] Ebuild 0.4.1 uses hierarchical versioned USE flags (avx and avx2). Flat, explicitly versioned flags (e.g. avx2 only) are recommended.
[Warning] Ebuild 0.4.0 uses hierarchical versioned USE flags (avx and avx2). Flat, explicitly versioned flags (e.g. avx2 only) are recommended.

USE Flags

Manage flags for this package: euse -i <flag> -p sci-misc/llama-cpp | euse -E <flag> -p sci-misc/llama-cpp | euse -D <flag> -p sci-misc/llama-cpp

Flag	Description	9999	0.4.1	0.4.0
"(	⚠️	✓	✓	✓
(	⚠️	✓	✓	✓
)	⚠️	✓	✓	✓
)"	⚠️	✓	✓	✓
amx_bf16	⚠️	✓	✓	✓
amx_int8	⚠️	✓	✓	✓
amx_tile	⚠️	✓	✓	✓
avx	⚠️	✓	✓	✓
avx2	⚠️	✓	✓	✓
avx512_bf16	⚠️	✓	✓	✓
avx512_vnni	⚠️	✓	✓	✓
avx512f	⚠️	✓	✓	✓
avx512vbmi	⚠️	✓	✓	✓
avx_vnni	⚠️	✓	✓	✓
blis	Build a BLIS backend	✓	✓	✓
bmi2	⚠️	✓	✓	✓
cuda	Enable NVIDIA CUDA support ⚠️	✓	✓	✓
curl	⚠️	✓	✓	✓
examples	Also install wl-present ⚠️	✓	✓	✓
f16c	⚠️	✓	✓	✓
flexiblas	Build a FlexiBLAS backend	✓	✓	✓
fma3	⚠️	✓	✓	✓
openblas	Build an OpenBLAS backend	✓	✓	✓
opencl	Build an OpenCL backend, so far only works on Adreno and Intel GPUs	✓	✓	✓
openmp	Enable OpenMP parallel compression ⚠️	⊕	⊕	⊕
openssl	Use openssl to support HTTPS	✓	✓	✓
rocm	Build a HIP (ROCm) backend	✓	✓	✓
sse4_2	⚠️	✓	✓	✓
test	Run mangohud tests ⚠️	✓	✓	✗
vulkan	Build vulkan renderer ⚠️	✓	✓	✓

Manifest

Type	File	Size	Versions
DIST	ggml-org_models_tinyllamas_stories15M-q4_0-99dd1a73db5a37100bd4ae633f4cfce6560e1567.gguf	19077344 bytes	9999, 0.4.1, 0.4.0
DIST	llama-b10809-ui.tar.gz	3084118 bytes	0.4.0
DIST	llama-b10964-ui.tar.gz	3084524 bytes	9999, 0.4.1
DIST	llama-cpp-0.4.0.tar.gz	37288249 bytes	0.4.0
DIST	llama-cpp-0.4.1.tar.gz	37422659 bytes	0.4.1

Unmatched Entries

Type	File	Size

sci-misc/llama-cpp (guru)