Install this package:
emerge -a localai-backend/vllm-cpp
| Version | EAPI | Keywords | Slot |
|---|---|---|---|
| 4.11.0 | 8 | ~amd64 | 0 |
<pkgmetadata> <maintainer type="person"> <email>plamen@ipnmod.org</email> <name>Plamen K. Kosseff</name> </maintainer> <use> <flag name="vulkan">GPU acceleration via Vulkan</flag> </use> <upstream> <remote-id type="github">mudler/LocalAI</remote-id> </upstream> </pkgmetadata>
Manage flags for this package:
euse -i <flag> -p localai-backend/vllm-cpp |
euse -E <flag> -p localai-backend/vllm-cpp |
euse -D <flag> -p localai-backend/vllm-cpp
| Flag | Description | 4.11.0 |
|---|---|---|
| video_cards_amdgpu | ⚠️ | ✓ |
| vulkan | GPU acceleration via Vulkan | ✓ |
| Type | File | Size | Versions |
|---|---|---|---|
| DIST | vllm.cpp-a19294a9ae2248e66d0206ecedee1b9041944e59.tar.gz | 115129390 bytes | 4.11.0 |
| Type | File | Size |
|---|---|---|
| DIST | localai-4.11.0-deps.tar.xz | 984649604 bytes |
| DIST | localai-4.11.0-prebuilt.tar.xz | 59704 bytes |
| DIST | localai-4.11.0.tar.gz | 27596319 bytes |
| EBUILD | vllm-cpp-4.11.0.ebuild | 3883 bytes |
| MISC | metadata.xml | 402 bytes |