Gentoo Packages

sci-ml/tokenizers (gentoo)

Search

Install

Install this package:

emerge -a sci-ml/tokenizers

Package Information

Description:
Implementation of today's most used tokenizers
Homepage:
https://github.com/huggingface/tokenizers
License:
Apache-2.0 Apache-2.0 Apache-2.0-with-LLVM-exceptions BSD-2 BSD ISC MIT MPL-2.0 Unicode-DFS-2016

Versions

Version EAPI Keywords Slot
0.23.1 8 ~amd64 0
0.22.2 8 ~amd64 0
0.22.1 8 ~amd64 0

Metadata

Maintainers

Upstream

Raw Metadata XML 
<pkgmetadata>
	<maintainer type="person">
		<email>tupone@gentoo.org</email>
		<name>Tupone Alfredo</name>
	</maintainer>
	<upstream>
		<remote-id type="github">huggingface/tokenizers</remote-id>
	</upstream>
</pkgmetadata>

Lint Warnings

Files

Manifest

Type File Size Versions
DIST tokenizers-0.22.1.gh.tar.gz 1563505 bytes 0.22.1
DIST tokenizers-0.22.2.gh.tar.gz 1568453 bytes 0.22.2
DIST tokenizers-0.23.1.gh.tar.gz 1613786 bytes 0.23.1
Unmatched Entries
Type File Size
DIST tokenizers-0.22.0-crates.tar.xz 20740996 bytes
DIST tokenizers-0.22.2-crates.tar.xz 21576112 bytes
DIST tokenizers-0.23.1-crates.tar.xz 21626500 bytes
DIST tokenizers-python-0.22.1-crates.tar.xz 14184544 bytes
DIST tokenizers-python-0.22.2-crates.tar.xz 9862444 bytes
DIST tokenizers-python-0.23.1-crates.tar.xz 10988872 bytes