Gentoo Packages

app-misc/llama-cpp (zGentoo)

Search

Install

Install this package:

emerge -a app-misc/llama-cpp

Package Information

Description:
LLM inference in C/C++ (GGML/GGUF) — CPU + optional GPU backends
Homepage:
https://github.com/ggml-org/llama.cpp
License:
MIT

Versions

Version EAPI Keywords Slot
9608 8 ~amd64 0
9490 8 ~amd64 0

Metadata

No metadata available.

Lint Warnings

USE Flags

Manage flags for this package: euse -i <flag> -p app-misc/llama-cpp | euse -E <flag> -p app-misc/llama-cpp | euse -D <flag> -p app-misc/llama-cpp

Flag Description 9608 9490
blis ⚠️ ✓ ✓
cpu_flags_x86_avx ⚠️ ✓ ✓
cpu_flags_x86_avx2 ⚠️ ✓ ✓
cpu_flags_x86_avx512_bf16 ⚠️ ✓ ✓
cpu_flags_x86_avx512_vnni ⚠️ ✓ ✓
cpu_flags_x86_avx512f ⚠️ ✓ ✓
cpu_flags_x86_avx512vbmi ⚠️ ✓ ✓
cpu_flags_x86_avx_vnni ⚠️ ✓ ✓
cpu_flags_x86_bmi2 ⚠️ ✓ ✓
cpu_flags_x86_f16c ⚠️ ✓ ✓
cpu_flags_x86_fma3 ⚠️ ✓ ✓
cuda ⚠️ ✓ ✓
curl ⚠️ ✓ ✓
examples Build examples ⚠️ ✓ ✓
flexiblas ⚠️ ✓ ✓
openblas ⚠️ ✓ ✓
opencl ⚠️ ✓ ✓
openmp ⚠️ ⊕ ⊕
openssl ⚠️ ✓ ✓
rocm ⚠️ ✓ ✓
vulkan ⚠️ ✓ ✓
wmma ⚠️ ✓ ✓

Manifest

Type File Size Versions
DIST llama-cpp-9490.gh.tar.gz 34031430 bytes 9490
DIST llama-cpp-9608.gh.tar.gz 34788363 bytes 9608
Unmatched Entries
Type File Size
AUX llama-server.conf 1123 bytes
AUX llama-server.service 1610 bytes
DIST ggml-org_models_tinyllamas_stories15M-q4_0-99dd1a73db5a37100bd4ae633f4cfce6560e1567.gguf 19077344 bytes
EBUILD llama-cpp-9490.ebuild 6923 bytes
EBUILD llama-cpp-9608.ebuild 7122 bytes