Install this package:
emerge -a sci-misc/llama-cpp
| Version | EAPI | Keywords | Slot |
|---|---|---|---|
| 9999 | 8 | ~amd64 | 0 |
<pkgmetadata> <maintainer type="person"> <email>zl29ah@gmail.com</email> <name>Sergey Alirzaev</name> </maintainer> <use> <flag name="blis">Build a BLIS backend</flag> <flag name="flexiblas">Build a FlexiBLAS backend</flag> <flag name="rocm">Build a HIP (ROCm) backend</flag> <flag name="hip">Build a HIP (ROCm) backend</flag> <flag name="wmma">Use rocWMMA to enhance flash attention performance</flag> <flag name="openblas">Build an OpenBLAS backend</flag> <flag name="opencl">Build an OpenCL backend, so far only works on Adreno and Intel GPUs</flag> <flag name="openssl">Use openssl to support HTTPS</flag> </use> <upstream> <remote-id type="github">ggml-org/llama.cpp</remote-id> </upstream> </pkgmetadata>
Manage flags for this package:
euse -i <flag> -p sci-misc/llama-cpp |
euse -E <flag> -p sci-misc/llama-cpp |
euse -D <flag> -p sci-misc/llama-cpp
| Flag | Description | 9999 |
|---|---|---|
| blis | Build a BLIS backend | ✓ |
| cuda | ⚠️ | ✓ |
| curl | Use curl for http,https and ftp backends ⚠️ | ✓ |
| examples | ⚠️ | ✓ |
| flexiblas | Build a FlexiBLAS backend | ✓ |
| openblas | Build an OpenBLAS backend | ✓ |
| opencl | Build an OpenCL backend, so far only works on Adreno and Intel GPUs | ✓ |
| openmp | ⚠️ | ⊕ |
| openssl | Use openssl to support HTTPS | ✓ |
| rocm | Build a HIP (ROCm) backend | ✓ |
| vulkan | ⚠️ | ✓ |
| wmma | Use rocWMMA to enhance flash attention performance | ✓ |
| Type | File | Size | Versions |
|---|
| Type | File | Size |
|---|---|---|
| DIST | ggml-org_models_tinyllamas_stories15M-q4_0-99dd1a73db5a37100bd4ae633f4cfce6560e1567.gguf | 19077344 bytes |