Install this package:
emerge -a localai-backend/vllm-cpp
| Version | EAPI | Keywords | Slot |
|---|---|---|---|
| 4.12.1 | 8 | ~amd64 | 0 |
<pkgmetadata> <maintainer type="person"> <email>plamen@ipnmod.org</email> <name>Plamen K. Kosseff</name> </maintainer> <use> <flag name="vulkan">GPU acceleration via Vulkan</flag> </use> <upstream> <remote-id type="github">mudler/LocalAI</remote-id> </upstream> </pkgmetadata>
Manage flags for this package:
euse -i <flag> -p localai-backend/vllm-cpp |
euse -E <flag> -p localai-backend/vllm-cpp |
euse -D <flag> -p localai-backend/vllm-cpp
| Flag | Description | 4.12.1 |
|---|---|---|
| video_cards_amdgpu | ⚠️ | ✓ |
| vulkan | GPU acceleration via Vulkan | ✓ |
| Type | File | Size | Versions |
|---|---|---|---|
| DIST | vllm.cpp-46c6846b939313b591f71825a5f5878918663795.tar.gz | 123300296 bytes | 4.12.1 |
| Type | File | Size |
|---|---|---|
| DIST | localai-4.12.1-deps.tar.xz | 1005786440 bytes |
| DIST | localai-4.12.1-prebuilt.tar.xz | 67764 bytes |
| DIST | localai-4.12.1.tar.gz | 30086342 bytes |
| EBUILD | vllm-cpp-4.12.1.ebuild | 3916 bytes |
| MISC | metadata.xml | 402 bytes |