sci-misc/kvmem-llama-cpp (ruizhi-overlay)

Search

Install

Install this package:

emerge -a sci-misc/kvmem-llama-cpp

Package Information

Description:
CUDA llama.cpp runtime with tiered KV memory for long contexts
Homepage:
https://github.com/kvmem/kvmem-llama.cpp
License:
Apache-2.0 MIT

Versions

Version EAPI Keywords Slot
0.17.0 8 ~amd64 0

Metadata

Maintainers

Upstream

Raw Metadata XML
<pkgmetadata>
	<maintainer type="person">
		<email>ruizhi.zhong88@gmail.com</email>
		<name>Ruizhi Zhong</name>
	</maintainer>
	<upstream>
		<remote-id type="github">kvmem/kvmem-llama.cpp</remote-id>
	</upstream>
</pkgmetadata>

Lint Warnings

USE Flags

Manage flags for this package: euse -i <flag> -p sci-misc/kvmem-llama-cpp | euse -E <flag> -p sci-misc/kvmem-llama-cpp | euse -D <flag> -p sci-misc/kvmem-llama-cpp

Flag Description 0.17.0
cpu_flags_x86_avx ⚠️ ✓
cpu_flags_x86_avx2 ⚠️ ✓
cpu_flags_x86_bmi2 ⚠️ ✓
cpu_flags_x86_f16c ⚠️ ✓
cpu_flags_x86_fma3 ⚠️ ✓
cpu_flags_x86_sse4_2 ⚠️ ✓
openmp ⚠️ ⊕
test ⚠️ ✓

Files

Manifest

Type File Size Versions
DIST kvmem-llama-cpp-0.17.0.tar.gz 753608 bytes 0.17.0
DIST llama.cpp-b81c99b479d4c24e5eeca10de99032ebd343ef8f.tar.gz 37141295 bytes 0.17.0
Unmatched Entries
Type File Size