Gentoo Packages

sci-ml/ggml (pf4public)

Search

Install

Install this package:

emerge -a sci-ml/ggml

Package Information

Description:
ggml is a library for performing tensor operations used by the ggml-org projects (llama.cpp, whisper.cpp, ...). This ebuild is an overlay of sci-ml/ggml::gentoo that adds the openblas, opencl and rpc backend flags.
Homepage:
https://ggml.ai/
License:
MIT

Versions

Version EAPI Keywords Slot
9999 8 ~amd64 ~arm64 0/9999
0.28.0 8 amd64 ~arm64 0/0.28.0
0.27.0 8 ~amd64 ~arm64 0/0.27.0

Metadata

Description

Maintainers

Upstream

Raw Metadata XML 
<pkgmetadata>
	<maintainer type="person">
		<email>PF4Public@users.noreply.github.com</email>
	</maintainer>
	<longdescription>
		ggml is a library for performing tensor operations used by the
		ggml-org projects (llama.cpp, whisper.cpp, ...). This ebuild is an
		overlay of sci-ml/ggml::gentoo that adds the openblas, opencl and
		rpc backend flags.
	</longdescription>
	<use>
		<flag name="cuda">Enable the NVIDIA CUDA GPU backend</flag>
		<flag name="openblas">Enable the OpenBLAS backend (GGML_BLAS)</flag>
		<flag name="opencl">Enable the OpenCL backend</flag>
		<flag name="openmp">Use OpenMP in the CPU backend</flag>
		<flag name="rocm">Enable the AMD ROCm/HIP GPU backend</flag>
		<flag name="rpc">Enable the RPC backend for distributed inference</flag>
		<flag name="src">Install the internal headers and sources (src/ and include/) for packages that compile parts of ggml themselves, e.g. sci-misc/strata with system-ggml</flag>
		<flag name="vulkan">Enable the Vulkan backend</flag>
	</use>
	<upstream>
		<bugs-to>https://github.com/ggml-org/ggml/issues</bugs-to>
		<remote-id type="github">ggml-org/ggml</remote-id>
	</upstream>
</pkgmetadata>

Lint Warnings

USE Flags

Manage flags for this package: euse -i <flag> -p sci-ml/ggml | euse -E <flag> -p sci-ml/ggml | euse -D <flag> -p sci-ml/ggml

Flag Description 9999 0.28.0 0.27.0
"( ⚠️ ✓ ✓ ✓
( ⚠️ ✓ ✓ ✓
) ⚠️ ✓ ✓ ✓
)" ⚠️ ✓ ✓ ✓
amx_bf16 ⚠️ ✓ ✓ ✓
amx_int8 ⚠️ ✓ ✓ ✓
amx_tile ⚠️ ✓ ✓ ✓
avx ⚠️ ✓ ✓ ✓
avx2 ⚠️ ✓ ✓ ✓
avx512_bf16 ⚠️ ✓ ✓ ✓
avx512_vnni ⚠️ ✓ ✓ ✓
avx512bw ⚠️ ✓ ✓ ✓
avx512f ⚠️ ✓ ✓ ✓
avx512vbmi ⚠️ ✓ ✓ ✓
avx_vnni ⚠️ ✓ ✓ ✓
bmi2 ⚠️ ✓ ✓ ✓
cuda Enable the NVIDIA CUDA GPU backend ✓ ✓ ✓
f16c ⚠️ ✓ ✓ ✓
fma3 ⚠️ ✓ ✓ ✓
openblas Enable the OpenBLAS backend (GGML_BLAS) ✓ ✓ ✓
opencl Enable the OpenCL backend ✓ ✓ ✓
openmp Use OpenMP in the CPU backend ✓ ✓ ✓
rocm Enable the AMD ROCm/HIP GPU backend ✓ ✓ ✓
rpc Enable the RPC backend for distributed inference ✓ ✓ ✓
src Install the internal headers and sources (src/ and include/) for packages that compile parts of ggml themselves, e.g. sci-misc/strata with system-ggml ✓ ✓ ✓
sse4_2 ⚠️ ✓ ✓ ✓
test ⚠️ ✓ ✓ ✓
vulkan Enable the Vulkan backend ✓ ✓ ✓

Files

Manifest

Type File Size Versions
DIST ggml-0.27.0.tar.gz 4303837 bytes 0.27.0
DIST ggml-0.28.0.tar.gz 4415832 bytes 0.28.0
Unmatched Entries
Type File Size