dev-python/llmlingua (pypi)

Search

Install

Install this package:

emerge -a dev-python/llmlingua

If the package is masked, you can unmask it using the autounmask tool or standard emerge options:

autounmask dev-python/llmlingua

Or alternatively:

emerge --autounmask-write -a dev-python/llmlingua

Package Information

Description:
To speed up LLMs' inference and enhance LLM's perceive of key information, compress the prompt and KV-Cache, which achieves up to 20x compression with minimal performance loss.
Homepage:
https://github.com/microsoft/LLMLingua
License:
MIT

Versions

Version EAPI Keywords Slot
0.2.1 8 ~amd64 ~x86 0

Metadata

Maintainers

Raw Metadata XML
<pkgmetadata>
	<maintainer type="person">
		<email>gentoo@houseofsuns.org</email>
		<name>Markus Walter</name>
	</maintainer>
</pkgmetadata>

Lint Warnings

USE Flags

Manage flags for this package: euse -i <flag> -p dev-python/llmlingua | euse -E <flag> -p dev-python/llmlingua | euse -D <flag> -p dev-python/llmlingua

Flag Description 0.2.1
dev ⚠️
quality ⚠️

Manifest

Type File Size Versions
DIST llmlingua-0.2.1.tar.gz 58402 bytes 0.2.1
Unmatched Entries
Type File Size
EBUILD llmlingua-0.2.1.ebuild 1981 bytes
MISC metadata.xml 250 bytes