Gentoo Packages

Search

Install

Install this package:

emerge -a dev-python/instanttensor-bin

Package Information

Description:

InstantTensor is a safetensors loader that reads model weights straight into GPU memory over io_uring, libaio, cuFile or an in-memory path, and pipelines the prefetch across ranks of a torch process group. vllm exposes it as the "instanttensor" load format.

Homepage:

https://pypi.org/project/instanttensor/

License:

Apache-2.0 BSD LGPL-2.1 MIT

Versions

Metadata

Description

• InstantTensor is a safetensors loader that reads model weights straight into GPU memory over io_uring, libaio, cuFile or an in-memory path, and pipelines the prefetch across ranks of a torch process group. vllm exposes it as the "instanttensor" load format.

Maintainers

• Ivan S. Titov (iohann.s.titov@gmail.com) - Type: person

Upstream

• Remote IDs:
  • pypi: instanttensor

<pkgmetadata>
	<maintainer type="person">
		<email>iohann.s.titov@gmail.com</email>
		<name>Ivan S. Titov</name>
	</maintainer>
	<longdescription>InstantTensor is a safetensors loader that reads model weights straight into GPU memory over io_uring, libaio, cuFile or an in-memory path, and pipelines the prefetch across ranks of a torch process group. vllm exposes it as the "instanttensor" load format.</longdescription>
	<upstream>
		<remote-id type="pypi">instanttensor</remote-id>
	</upstream>
</pkgmetadata>

Lint Warnings

• [Error] Ebuild 0.2.2 uses '${D}' in 'python_install'. It must be used only in src_install and pkg_preinst.
• [Error] Ebuild 0.2.1 uses '${D}' in 'python_install'. It must be used only in src_install and pkg_preinst.
• [Error] Ebuild 0.2.0 uses '${D}' in 'python_install'. It must be used only in src_install and pkg_preinst.
• [Warning] Ebuild 0.2.2 has a line exceeding 80 positions on line 22.
• [Warning] Ebuild 0.2.2 has a line exceeding 80 positions on line 25.
• [Warning] Ebuild 0.2.2 has a line exceeding 80 positions on line 28.
• [Warning] Ebuild 0.2.1 has a line exceeding 80 positions on line 22.
• [Warning] Ebuild 0.2.1 has a line exceeding 80 positions on line 25.
• [Warning] Ebuild 0.2.1 has a line exceeding 80 positions on line 28.
• [Warning] Ebuild 0.2.0 has a line exceeding 80 positions on line 22.
• [Warning] Ebuild 0.2.0 has a line exceeding 80 positions on line 25.
• [Warning] Ebuild 0.2.0 has a line exceeding 80 positions on line 28.
• [Notice] Package has only unstable keywords for arch(es): [ amd64 ], all versions are unstable: [ 0.2.0, 0.2.1, 0.2.2 ]

Manifest