Gentoo Packages

Search

Install

Install this package:

emerge -a dev-python/instanttensor-bin

Package Information

Description:

InstantTensor is a safetensors loader that reads model weights straight into GPU memory over io_uring, libaio, cuFile or an in-memory path, and pipelines the prefetch across ranks of a torch process group. vllm exposes it as the "instanttensor" load format.

Homepage:

https://pypi.org/project/instanttensor/

License:

Apache-2.0 BSD LGPL-2.1 MIT

Versions

Metadata

Description

• InstantTensor is a safetensors loader that reads model weights straight into GPU memory over io_uring, libaio, cuFile or an in-memory path, and pipelines the prefetch across ranks of a torch process group. vllm exposes it as the "instanttensor" load format.

Maintainers

• Ivan S. Titov (iohann.s.titov@gmail.com) - Type: person

Upstream

• Remote IDs:
  • pypi: instanttensor

<pkgmetadata>
	<maintainer type="person">
		<email>iohann.s.titov@gmail.com</email>
		<name>Ivan S. Titov</name>
	</maintainer>
	<longdescription>InstantTensor is a safetensors loader that reads model weights straight into GPU memory over io_uring, libaio, cuFile or an in-memory path, and pipelines the prefetch across ranks of a torch process group. vllm exposes it as the "instanttensor" load format.</longdescription>
	<upstream>
		<remote-id type="pypi">instanttensor</remote-id>
	</upstream>
</pkgmetadata>

Lint Warnings

• [Error] Ebuild 0.2.0 uses '${D}' in 'python_install'. It must be used only in src_install and pkg_preinst.
• [Error] Ebuild 0.1.9 uses '${D}' in 'python_install'. It must be used only in src_install and pkg_preinst.
• [Warning] Ebuild 0.2.0 has a line exceeding 80 positions on line 22.
• [Warning] Ebuild 0.2.0 has a line exceeding 80 positions on line 25.
• [Warning] Ebuild 0.2.0 has a line exceeding 80 positions on line 28.
• [Warning] Ebuild 0.1.9 has a line exceeding 80 positions on line 22.
• [Warning] Ebuild 0.1.9 has a line exceeding 80 positions on line 25.
• [Warning] Ebuild 0.1.9 has a line exceeding 80 positions on line 28.
• [Error] Manifest entry for unused DIST file 'instanttensor-0.1.9-cp312-cp312-manylinux_2_24_x86_64.manylinux_2_28_x86_64.whl'
• [Error] Manifest entry for unused DIST file 'instanttensor-0.1.9-cp313-cp313-manylinux_2_24_x86_64.manylinux_2_28_x86_64.whl'
• [Error] Manifest entry for unused DIST file 'instanttensor-0.1.9-cp314-cp314-manylinux_2_24_x86_64.manylinux_2_28_x86_64.whl'
• [Error] Manifest entry for unused DIST file 'instanttensor-0.2.0-cp312-cp312-manylinux_2_27_x86_64.manylinux_2_28_x86_64.whl'
• [Error] Manifest entry for unused DIST file 'instanttensor-0.2.0-cp313-cp313-manylinux_2_27_x86_64.manylinux_2_28_x86_64.whl'
• [Error] Manifest entry for unused DIST file 'instanttensor-0.2.0-cp314-cp314-manylinux_2_27_x86_64.manylinux_2_28_x86_64.whl'
• [Error] Repository is missing a repo-name in metadata/layout.conf or profiles/repo_name
• [Notice] Package has only unstable keywords for arch(es): [ amd64 ], all versions are unstable: [ 0.1.9, 0.2.0 ]

Manifest