Gentoo Packages

Search

Install

Install this package:

emerge -a sci-misc/llama-cpp

Package Information

Description:

LLM inference in C/C++

Homepage:

https://github.com/ggml-org/llama.cpp

License:

MIT

Versions

Metadata

Maintainers

• Unknown (PF4Public@users.noreply.github.com) - Type: person

Upstream

• Bugs: https://github.com/ggml-org/llama.cpp/issues
• Remote IDs:
  • github: ggml-org/llama.cpp

<pkgmetadata>
	<maintainer type="person">
		<email>PF4Public@users.noreply.github.com</email>
	</maintainer>
	<use>
		<flag name="build-online">Allow the build to download the npm registry (live ebuild only, needed by the webui flag)</flag>
		<flag name="cuda">Enable the NVIDIA CUDA GPU backend</flag>
		<flag name="examples">Build the example programs</flag>
		<flag name="hip">Enable the AMD ROCm/HIP GPU backend</flag>
		<flag name="openblas">Enable the OpenBLAS backend</flag>
		<flag name="opencl">Enable the OpenCL backend</flag>
		<flag name="openmp">Use OpenMP in the CPU backend</flag>
		<flag name="openssl">Use OpenSSL for HTTPS model downloads</flag>
		<flag name="rpc">Enable the RPC backend for distributed inference</flag>
		<flag name="system-ggml">Link against the installed sci-ml/ggml instead of the bundled copy; the CPU ISA set and the backends are then selected by ggml's own USE flags</flag>
		<flag name="vulkan">Enable the Vulkan backend</flag>
		<flag name="webui">Embed the prebuilt web UI in llama-server</flag>
	</use>
	<upstream>
		<bugs-to>https://github.com/ggml-org/llama.cpp/issues</bugs-to>
		<remote-id type="github">ggml-org/llama.cpp</remote-id>
	</upstream>
</pkgmetadata>

Lint Warnings

• [Warning] Ebuild 9999 has a line exceeding 80 positions on line 38.
• [Warning] Ebuild 9999 has a line exceeding 80 positions on line 61.
• [Warning] Ebuild 9999 has a line exceeding 80 positions on line 124.
• [Warning] Ebuild 0.8.0 has a line exceeding 80 positions on line 38.
• [Warning] Ebuild 0.8.0 has a line exceeding 80 positions on line 61.
• [Warning] Ebuild 0.8.0 has a line exceeding 80 positions on line 124.
• [Warning] Ebuild 0.7.0 has a line exceeding 80 positions on line 38.
• [Warning] Ebuild 0.7.0 has a line exceeding 80 positions on line 61.
• [Warning] Ebuild 0.7.0 has a line exceeding 80 positions on line 124.
• [Warning] USE flag '(' in ebuild 9999 is not documented in metadata.xml
• [Warning] USE flag '"(' in ebuild 9999 is not documented in metadata.xml
• [Warning] USE flag 'amx_bf16' in ebuild 9999 is not documented in metadata.xml
• [Warning] USE flag 'amx_int8' in ebuild 9999 is not documented in metadata.xml
• [Warning] USE flag 'amx_tile' in ebuild 9999 is not documented in metadata.xml
• [Warning] USE flag 'avx' in ebuild 9999 is not documented in metadata.xml
• [Warning] USE flag 'avx2' in ebuild 9999 is not documented in metadata.xml
• [Warning] USE flag 'avx512_bf16' in ebuild 9999 is not documented in metadata.xml
• [Warning] USE flag 'avx512_vnni' in ebuild 9999 is not documented in metadata.xml
• [Warning] USE flag 'avx512f' in ebuild 9999 is not documented in metadata.xml
• [Warning] USE flag 'avx512vbmi' in ebuild 9999 is not documented in metadata.xml
• [Warning] USE flag 'avx_vnni' in ebuild 9999 is not documented in metadata.xml
• [Warning] USE flag 'bmi2' in ebuild 9999 is not documented in metadata.xml
• [Warning] USE flag 'f16c' in ebuild 9999 is not documented in metadata.xml
• [Warning] USE flag 'fma3' in ebuild 9999 is not documented in metadata.xml
• [Warning] USE flag 'sse4_2' in ebuild 9999 is not documented in metadata.xml
• [Warning] USE flag ')"' in ebuild 9999 is not documented in metadata.xml
• [Warning] USE flag ')' in ebuild 9999 is not documented in metadata.xml
• [Warning] USE flag '(' in ebuild 0.8.0 is not documented in metadata.xml
• [Warning] USE flag '"(' in ebuild 0.8.0 is not documented in metadata.xml
• [Warning] USE flag 'amx_bf16' in ebuild 0.8.0 is not documented in metadata.xml
• [Warning] USE flag 'amx_int8' in ebuild 0.8.0 is not documented in metadata.xml
• [Warning] USE flag 'amx_tile' in ebuild 0.8.0 is not documented in metadata.xml
• [Warning] USE flag 'avx' in ebuild 0.8.0 is not documented in metadata.xml
• [Warning] USE flag 'avx2' in ebuild 0.8.0 is not documented in metadata.xml
• [Warning] USE flag 'avx512_bf16' in ebuild 0.8.0 is not documented in metadata.xml
• [Warning] USE flag 'avx512_vnni' in ebuild 0.8.0 is not documented in metadata.xml
• [Warning] USE flag 'avx512f' in ebuild 0.8.0 is not documented in metadata.xml
• [Warning] USE flag 'avx512vbmi' in ebuild 0.8.0 is not documented in metadata.xml
• [Warning] USE flag 'avx_vnni' in ebuild 0.8.0 is not documented in metadata.xml
• [Warning] USE flag 'bmi2' in ebuild 0.8.0 is not documented in metadata.xml
• [Warning] USE flag 'f16c' in ebuild 0.8.0 is not documented in metadata.xml
• [Warning] USE flag 'fma3' in ebuild 0.8.0 is not documented in metadata.xml
• [Warning] USE flag 'sse4_2' in ebuild 0.8.0 is not documented in metadata.xml
• [Warning] USE flag ')"' in ebuild 0.8.0 is not documented in metadata.xml
• [Warning] USE flag ')' in ebuild 0.8.0 is not documented in metadata.xml
• [Warning] USE flag '(' in ebuild 0.7.0 is not documented in metadata.xml
• [Warning] USE flag '"(' in ebuild 0.7.0 is not documented in metadata.xml
• [Warning] USE flag 'amx_bf16' in ebuild 0.7.0 is not documented in metadata.xml
• [Warning] USE flag 'amx_int8' in ebuild 0.7.0 is not documented in metadata.xml
• [Warning] USE flag 'amx_tile' in ebuild 0.7.0 is not documented in metadata.xml
• [Warning] USE flag 'avx' in ebuild 0.7.0 is not documented in metadata.xml
• [Warning] USE flag 'avx2' in ebuild 0.7.0 is not documented in metadata.xml
• [Warning] USE flag 'avx512_bf16' in ebuild 0.7.0 is not documented in metadata.xml
• [Warning] USE flag 'avx512_vnni' in ebuild 0.7.0 is not documented in metadata.xml
• [Warning] USE flag 'avx512f' in ebuild 0.7.0 is not documented in metadata.xml
• [Warning] USE flag 'avx512vbmi' in ebuild 0.7.0 is not documented in metadata.xml
• [Warning] USE flag 'avx_vnni' in ebuild 0.7.0 is not documented in metadata.xml
• [Warning] USE flag 'bmi2' in ebuild 0.7.0 is not documented in metadata.xml
• [Warning] USE flag 'f16c' in ebuild 0.7.0 is not documented in metadata.xml
• [Warning] USE flag 'fma3' in ebuild 0.7.0 is not documented in metadata.xml
• [Warning] USE flag 'sse4_2' in ebuild 0.7.0 is not documented in metadata.xml
• [Warning] USE flag ')"' in ebuild 0.7.0 is not documented in metadata.xml
• [Warning] USE flag ')' in ebuild 0.7.0 is not documented in metadata.xml
• Bypassing the network sandbox using `RESTRICT="network-sandbox"` violates Gentoo's core packaging policies. Ebuilds must support offline and reproducible builds, meaning all assets must be fetched via `SRC_URI` during the fetch phase and verified using Manifest checksums. To resolve this, you should package the required dependencies (e.g., node modules, cargo crates) into a tarball, host it, reference it in `SRC_URI` and perform an offline installation.
• Bypassing the network sandbox using `RESTRICT="network-sandbox"` violates Gentoo's core packaging policies. Ebuilds must support offline and reproducible builds, meaning all assets must be fetched via `SRC_URI` during the fetch phase and verified using Manifest checksums. To resolve this, you should package the required dependencies (e.g., node modules, cargo crates) into a tarball, host it, reference it in `SRC_URI` and perform an offline installation.
• Bypassing the network sandbox using `RESTRICT="network-sandbox"` violates Gentoo's core packaging policies. Ebuilds must support offline and reproducible builds, meaning all assets must be fetched via `SRC_URI` during the fetch phase and verified using Manifest checksums. To resolve this, you should package the required dependencies (e.g., node modules, cargo crates) into a tarball, host it, reference it in `SRC_URI` and perform an offline installation.
• [Notice] Package has only unstable keywords for arch(es): [ arm64 ], all versions are unstable: [ 0.7.0, 0.8.0 ]
• [Warning] Ebuild 9999 uses a regular USE flag 'amx_bf16' containing an underscore. Underscores are reserved for USE_EXPAND flags.
• [Warning] Ebuild 9999 uses a regular USE flag 'amx_int8' containing an underscore. Underscores are reserved for USE_EXPAND flags.
• [Warning] Ebuild 9999 uses a regular USE flag 'amx_tile' containing an underscore. Underscores are reserved for USE_EXPAND flags.
• [Warning] Ebuild 9999 uses a regular USE flag 'avx512_bf16' containing an underscore. Underscores are reserved for USE_EXPAND flags.
• [Warning] Ebuild 9999 uses a regular USE flag 'avx512_vnni' containing an underscore. Underscores are reserved for USE_EXPAND flags.
• [Warning] Ebuild 9999 uses a regular USE flag 'avx_vnni' containing an underscore. Underscores are reserved for USE_EXPAND flags.
• [Warning] Ebuild 9999 uses a regular USE flag 'sse4_2' containing an underscore. Underscores are reserved for USE_EXPAND flags.
• [Warning] Ebuild 0.8.0 uses a regular USE flag 'amx_bf16' containing an underscore. Underscores are reserved for USE_EXPAND flags.
• [Warning] Ebuild 0.8.0 uses a regular USE flag 'amx_int8' containing an underscore. Underscores are reserved for USE_EXPAND flags.
• [Warning] Ebuild 0.8.0 uses a regular USE flag 'amx_tile' containing an underscore. Underscores are reserved for USE_EXPAND flags.
• [Warning] Ebuild 0.8.0 uses a regular USE flag 'avx512_bf16' containing an underscore. Underscores are reserved for USE_EXPAND flags.
• [Warning] Ebuild 0.8.0 uses a regular USE flag 'avx512_vnni' containing an underscore. Underscores are reserved for USE_EXPAND flags.
• [Warning] Ebuild 0.8.0 uses a regular USE flag 'avx_vnni' containing an underscore. Underscores are reserved for USE_EXPAND flags.
• [Warning] Ebuild 0.8.0 uses a regular USE flag 'sse4_2' containing an underscore. Underscores are reserved for USE_EXPAND flags.
• [Warning] Ebuild 0.7.0 uses a regular USE flag 'amx_bf16' containing an underscore. Underscores are reserved for USE_EXPAND flags.
• [Warning] Ebuild 0.7.0 uses a regular USE flag 'amx_int8' containing an underscore. Underscores are reserved for USE_EXPAND flags.
• [Warning] Ebuild 0.7.0 uses a regular USE flag 'amx_tile' containing an underscore. Underscores are reserved for USE_EXPAND flags.
• [Warning] Ebuild 0.7.0 uses a regular USE flag 'avx512_bf16' containing an underscore. Underscores are reserved for USE_EXPAND flags.
• [Warning] Ebuild 0.7.0 uses a regular USE flag 'avx512_vnni' containing an underscore. Underscores are reserved for USE_EXPAND flags.
• [Warning] Ebuild 0.7.0 uses a regular USE flag 'avx_vnni' containing an underscore. Underscores are reserved for USE_EXPAND flags.
• [Warning] Ebuild 0.7.0 uses a regular USE flag 'sse4_2' containing an underscore. Underscores are reserved for USE_EXPAND flags.
• [Warning] Ebuild 9999 uses hierarchical versioned USE flags (avx and avx2). Flat, explicitly versioned flags (e.g. avx2 only) are recommended.
• [Warning] Ebuild 0.8.0 uses hierarchical versioned USE flags (avx and avx2). Flat, explicitly versioned flags (e.g. avx2 only) are recommended.
• [Warning] Ebuild 0.7.0 uses hierarchical versioned USE flags (avx and avx2). Flat, explicitly versioned flags (e.g. avx2 only) are recommended.

USE Flags

Manage flags for this package: euse -i <flag> -p sci-misc/llama-cpp | euse -E <flag> -p sci-misc/llama-cpp | euse -D <flag> -p sci-misc/llama-cpp

Files

• llama-cpp-cdna-bf16.patch
• llama-cpp-llvm-23.patch

Manifest