localai-backend/vllm-cpp (local-ai)

Search

Install

Install this package:

emerge -a localai-backend/vllm-cpp

Package Information

Description:
LocalAI text-generation backend (vllm.cpp gRPC server)
Homepage:
https://localai.io https://github.com/mudler/LocalAI
License:
Apache-2.0 MIT

Versions

Version EAPI Keywords Slot
4.11.0 8 ~amd64 0

Metadata

Maintainers

Upstream

Raw Metadata XML
<pkgmetadata>
	<maintainer type="person">
		<email>plamen@ipnmod.org</email>
		<name>Plamen K. Kosseff</name>
	</maintainer>
	<use>
		<flag name="vulkan">GPU acceleration via Vulkan</flag>
	</use>
	<upstream>
		<remote-id type="github">mudler/LocalAI</remote-id>
	</upstream>
</pkgmetadata>

Lint Warnings

USE Flags

Manage flags for this package: euse -i <flag> -p localai-backend/vllm-cpp | euse -E <flag> -p localai-backend/vllm-cpp | euse -D <flag> -p localai-backend/vllm-cpp

Flag Description 4.11.0
video_cards_amdgpu ⚠️ ✓
vulkan GPU acceleration via Vulkan ✓

Manifest

Type File Size Versions
DIST vllm.cpp-a19294a9ae2248e66d0206ecedee1b9041944e59.tar.gz 115129390 bytes 4.11.0
Unmatched Entries
Type File Size
DIST localai-4.11.0-deps.tar.xz 984649604 bytes
DIST localai-4.11.0-prebuilt.tar.xz 59704 bytes
DIST localai-4.11.0.tar.gz 27596319 bytes
EBUILD vllm-cpp-4.11.0.ebuild 3883 bytes
MISC metadata.xml 402 bytes