Gentoo Packages

Search

Install

Install this package:

emerge -a dev-python/tokenizers

Package Information

Description:

Fast tokenizers for research and production

Homepage:

https://github.com/huggingface/tokenizers https://pypi.org/project/tokenizers/

License:

Apache-2.0 MIT Unicode-DFS-2016

Versions

Metadata

Maintainers

• Plamen K. Kosseff (plamen@ipnmod.org) - Type: person

Upstream

• Remote IDs:
  • github: huggingface/tokenizers
  • pypi: tokenizers

<pkgmetadata>
	<maintainer type="person">
		<email>plamen@ipnmod.org</email>
		<name>Plamen K. Kosseff</name>
	</maintainer>
	<upstream>
		<remote-id type="github">huggingface/tokenizers</remote-id>
		<remote-id type="pypi">tokenizers</remote-id>
	</upstream>
</pkgmetadata>

Lint Warnings

• [Warning] Ebuild 0.22.2 has a line exceeding 80 positions on line 22.
• [Warning] Ebuild 0.22.2 has a line exceeding 80 positions on line 25.
• [Error] Manifest entry for unused DIST file 'tokenizers-0.22.2-crates.tar.xz'
• [Error] Manifest entry for unused DIST file 'tokenizers-0.22.2.tar.gz'
• [Error] Repository is missing a repo-name in metadata/layout.conf or profiles/repo_name
• [Notice] Package has only unstable keywords for arch(es): [ amd64 ], all versions are unstable: [ 0.22.2 ]

Manifest