app-local-ai/vllm-cpp (local-ai)

Search

Install

Install this package:

emerge -a app-local-ai/vllm-cpp

Package Information

Description:
LocalAI text-generation backend (vllm.cpp gRPC server)
Homepage:
https://localai.io https://github.com/mudler/LocalAI
License:
Apache-2.0 MIT

Versions

Version EAPI Keywords Slot
4.9.0 8 ~amd64 0

Metadata

Maintainers

Upstream

Raw Metadata XML
<pkgmetadata>
	<maintainer type="person">
		<email>plamen@ipnmod.org</email>
		<name>Plamen K. Kosseff</name>
	</maintainer>
	<use>
		<flag name="vulkan">GPU acceleration via Vulkan</flag>
	</use>
	<upstream>
		<remote-id type="github">mudler/LocalAI</remote-id>
	</upstream>
</pkgmetadata>

Lint Warnings

USE Flags

Manage flags for this package: euse -i <flag> -p app-local-ai/vllm-cpp | euse -E <flag> -p app-local-ai/vllm-cpp | euse -D <flag> -p app-local-ai/vllm-cpp

Flag Description 4.9.0
video_cards_amdgpu ⚠️
vulkan GPU acceleration via Vulkan

Manifest

Type File Size Versions
DIST vllm.cpp-438305e1577768ec0f75729456a4c8b9f425e2ee.tar.gz 82221277 bytes 4.9.0
Unmatched Entries
Type File Size
AUX run.sh 347 bytes
DIST local-ai-4.9.0-deps.tar.xz 977532744 bytes
DIST local-ai-4.9.0-prebuilt.tar.xz 56688 bytes
DIST local-ai-4.9.0.tar.gz 26114251 bytes
EBUILD vllm-cpp-4.9.0.ebuild 3506 bytes
MISC metadata.xml 402 bytes