dev-python/flexgen (pypi)

Search

Package Information

Description:
Running large language models like OPT-175B/GPT-3 on a single GPU. Focusing on high-throughput large-batch generation.
Homepage:
https://github.com/FMInference/FlexGen

Versions

Version EAPI Keywords Slot
1.0 8 ~amd64 ~x86 0
0.1.8 8 ~amd64 ~x86 0

Metadata

Maintainers

Raw Metadata XML
<pkgmetadata>
	<maintainer type="person">
		<email>gentoo@houseofsuns.org</email>
		<name>Markus Walter</name>
	</maintainer>
</pkgmetadata>

Lint Warnings

Manifest

Type File Size Versions
DIST flexgen-0.1.8.tar.gz 118629 bytes 0.1.8
DIST flexgen-1.0.tar.gz 45600 bytes 1.0
Unmatched Entries
Type File Size
EBUILD flexgen-0.1.8.ebuild 1001 bytes
EBUILD flexgen-1.0.ebuild 1001 bytes
MISC metadata.xml 250 bytes