Gentoo Packages

Search

Install

Install this package:

emerge -a sci-misc/llama-cpp

Package Information

Description:

Port of Facebook's LLaMA model in C/C++

Homepage:

https://github.com/ggml-org/llama.cpp

License:

MIT

Versions

Metadata

Maintainers

• Vjaceslavs Klimovs (vklimovs@gmail.com) - Type: person

Upstream

• Remote IDs:
  • github: ggml-org/llama.cpp

<pkgmetadata>
	<maintainer type="person">
		<email>vklimovs@gmail.com</email>
		<name>Vjaceslavs Klimovs</name>
	</maintainer>
	<use>
		<flag name="blis">Build a BLIS BLAS backend</flag>
		<flag name="flexiblas">Build a FlexiBLAS BLAS backend</flag>
		<flag name="openblas">Build an OpenBLAS BLAS backend</flag>
		<flag name="opencl">Build an OpenCL backend (Adreno and Intel GPUs only)</flag>
		<flag name="openssl">Use OpenSSL for HTTPS in the server and model downloader</flag>
		<flag name="rocm">Build a HIP (ROCm) backend for AMD GPUs</flag>
		<flag name="rpc">Enable the RPC backend and rpc-server tool for distributed inference (unauthenticated; do not expose to untrusted networks)</flag>
		<flag name="wmma">Use rocWMMA to accelerate Flash Attention on supported AMD GPUs</flag>
	</use>
	<upstream>
		<remote-id type="github">ggml-org/llama.cpp</remote-id>
	</upstream>
</pkgmetadata>

Lint Warnings

• [Warning] USE flag 'cpu_flags_x86_avx' in ebuild 9999 is not documented in metadata.xml
• [Warning] USE flag 'cpu_flags_x86_avx2' in ebuild 9999 is not documented in metadata.xml
• [Warning] USE flag 'cpu_flags_x86_f16c' in ebuild 9999 is not documented in metadata.xml
• [Warning] USE flag 'cpu_flags_x86_fma3' in ebuild 9999 is not documented in metadata.xml
• [Warning] USE flag 'cpu_flags_x86_sse4_2' in ebuild 9999 is not documented in metadata.xml
• [Warning] USE flag 'cuda' in ebuild 9999 is not documented in metadata.xml
• [Warning] USE flag 'openmp' in ebuild 9999 is not documented in metadata.xml
• [Warning] USE flag 'vulkan' in ebuild 9999 is not documented in metadata.xml
• [Warning] USE flag 'cpu_flags_x86_avx' in ebuild 0_pre9715 is not documented in metadata.xml
• [Warning] USE flag 'cpu_flags_x86_avx2' in ebuild 0_pre9715 is not documented in metadata.xml
• [Warning] USE flag 'cpu_flags_x86_f16c' in ebuild 0_pre9715 is not documented in metadata.xml
• [Warning] USE flag 'cpu_flags_x86_fma3' in ebuild 0_pre9715 is not documented in metadata.xml
• [Warning] USE flag 'cpu_flags_x86_sse4_2' in ebuild 0_pre9715 is not documented in metadata.xml
• [Warning] USE flag 'cuda' in ebuild 0_pre9715 is not documented in metadata.xml
• [Warning] USE flag 'openmp' in ebuild 0_pre9715 is not documented in metadata.xml
• [Warning] USE flag 'vulkan' in ebuild 0_pre9715 is not documented in metadata.xml
• [Error] Missing md5-cache for ebuild llama-cpp-9999
• [Error] Missing md5-cache for ebuild llama-cpp-0_pre9715

USE Flags

Manage flags for this package: euse -i <flag> -p sci-misc/llama-cpp | euse -E <flag> -p sci-misc/llama-cpp | euse -D <flag> -p sci-misc/llama-cpp

Files

• llama-cpp-blas-ld.patch

Manifest