Install this package:
emerge -a sci-misc/llama-cpp
<pkgmetadata> <maintainer type="person"> <email>negril.nx+gentoo@gmail.com</email> <name>Paul Zander</name> </maintainer> <maintainer type="person"> <email>stefan@sydow.email</email> <name>Stefan Sydow</name> </maintainer> <maintainer type="person"> <email>gilles.dartiguelongue@esiee.org</email> <name>Gilles Dartiguelongue</name> </maintainer> <use> <flag name="blis">Build a BLIS backend</flag> <flag name="flexiblas">Build a FlexiBLAS backend</flag> <flag name="openblas">Build an OpenBLAS backend</flag> <flag name="opencl">Build an OpenCL backend, so far only works on Adreno and Intel GPUs</flag> <flag name="openssl">Use openssl to support HTTPS</flag> <flag name="rocm">Build a HIP (ROCm) backend</flag> </use> <upstream> <remote-id type="github">ggml-org/llama.cpp</remote-id> </upstream> </pkgmetadata>
Manage flags for this package:
euse -i <flag> -p sci-misc/llama-cpp |
euse -E <flag> -p sci-misc/llama-cpp |
euse -D <flag> -p sci-misc/llama-cpp
| Flag | Description | 9999 | 0.8.0 | 0.7.0 |
|---|---|---|---|---|
| "( | ⚠️ | ✓ | ✓ | ✓ |
| ( | ⚠️ | ✓ | ✓ | ✓ |
| ) | ⚠️ | ✓ | ✓ | ✓ |
| )" | ⚠️ | ✓ | ✓ | ✓ |
| amx_bf16 | ⚠️ | ✓ | ✓ | ✓ |
| amx_int8 | ⚠️ | ✓ | ✓ | ✓ |
| amx_tile | ⚠️ | ✓ | ✓ | ✓ |
| avx | ⚠️ | ✓ | ✓ | ✓ |
| avx2 | ⚠️ | ✓ | ✓ | ✓ |
| avx512_bf16 | ⚠️ | ✓ | ✓ | ✓ |
| avx512_vnni | ⚠️ | ✓ | ✓ | ✓ |
| avx512f | ⚠️ | ✓ | ✓ | ✓ |
| avx512vbmi | ⚠️ | ✓ | ✓ | ✓ |
| avx_vnni | ⚠️ | ✓ | ✓ | ✓ |
| blas | ⚠️ | ✓ | ✓ | ✓ |
| blis | Build a BLIS backend | ✓ | ✓ | ✓ |
| bmi2 | ⚠️ | ✓ | ✓ | ✓ |
| cuda | ⚠️ | ✓ | ✓ | ✓ |
| examples | Also install wl-present ⚠️ | ✓ | ✓ | ✓ |
| f16c | ⚠️ | ✓ | ✓ | ✓ |
| flexiblas | Build a FlexiBLAS backend | ✓ | ✓ | ✓ |
| fma3 | ⚠️ | ✓ | ✓ | ✓ |
| openblas | Build an OpenBLAS backend | ✓ | ✓ | ✓ |
| opencl | Build an OpenCL backend, so far only works on Adreno and Intel GPUs | ✓ | ✓ | ✓ |
| openmp | Enable OpenMP parallel compression ⚠️ | ⊕ | ⊕ | ⊕ |
| openssl | Use openssl to support HTTPS | ✓ | ✓ | ✓ |
| rocm | Build a HIP (ROCm) backend | ✓ | ✓ | ✓ |
| sse4_2 | ⚠️ | ✓ | ✓ | ✓ |
| test | Run mangohud tests ⚠️ | ✓ | ✓ | ✓ |
| vulkan | Build Vulkan renderer ⚠️ | ✓ | ✓ | ✓ |
| Type | File | Size | Versions |
|---|---|---|---|
| DIST | ggml-org_models_tinyllamas_stories15M-q4_0-99dd1a73db5a37100bd4ae633f4cfce6560e1567.gguf | 19077344 bytes | 9999, 0.8.0, 0.7.0 |
| DIST | llama-b11429-ui.tar.gz | 3099802 bytes | 0.7.0 |
| DIST | llama-b11960-ui.tar.gz | 3244974 bytes | 9999, 0.8.0 |
| DIST | llama-cpp-0.7.0.tar.gz | 38183379 bytes | 0.7.0 |
| DIST | llama-cpp-0.8.0.tar.gz | 38680037 bytes | 0.8.0 |
| Type | File | Size |
|---|