Gentoo Packages

dev-python/tiktoken (stuff)

Search

Install

Install this package:

emerge -a dev-python/tiktoken

Package Information

Description:
A fast BPE tokeniser for use with OpenAI's models
Homepage:
https://github.com/openai/tiktoken https://pypi.org/project/tiktoken/
License:
MIT Apache-2.0-with-LLVM-exceptions MIT Unicode-3.0

Versions

Version EAPI Keywords Slot
0.13.0 8 ~amd64 ~arm64 0
0.12.0 8 ~amd64 ~arm64 0

Metadata

Maintainers

Upstream

Raw Metadata XML 
<pkgmetadata>
	<maintainer type="person">
		<email>iohann.s.titov@gmail.com</email>
		<name>Ivan S. Titov</name>
	</maintainer>
	<upstream>
		<bugs-to>https://github.com/openai/tiktoken/issues</bugs-to>
		<remote-id type="pypi">tiktoken</remote-id>
		<remote-id type="github">openai/tiktoken</remote-id>
	</upstream>
</pkgmetadata>

Lint Warnings

Manifest

Type File Size Versions
Unmatched Entries
Type File Size
DIST aho-corasick-1.1.4.crate 184015 bytes
DIST autocfg-1.5.0.crate 18729 bytes
DIST bit-set-0.5.3.crate 14470 bytes
DIST bit-set-0.8.0.crate 16289 bytes
DIST bit-vec-0.6.3.crate 19927 bytes
DIST bit-vec-0.8.0.crate 24132 bytes
DIST bstr-1.12.1.crate 354916 bytes
DIST fancy-regex-0.13.0.crate 85930 bytes
DIST fancy-regex-0.17.0.crate 109054 bytes
DIST heck-0.5.0.crate 11517 bytes
DIST indoc-2.0.7.crate 17184 bytes
DIST libc-0.2.183.crate 816918 bytes
DIST libc-0.2.186.crate 821883 bytes
DIST memchr-2.8.0.crate 97780 bytes
DIST memoffset-0.9.1.crate 9032 bytes
DIST once_cell-1.21.4.crate 35010 bytes
DIST portable-atomic-1.13.1.crate 197001 bytes
DIST proc-macro2-1.0.106.crate 59765 bytes
DIST pyo3-0.26.0.crate 1151579 bytes
DIST pyo3-0.28.3.crate 1204476 bytes
DIST pyo3-build-config-0.26.0.crate 34309 bytes
DIST pyo3-build-config-0.28.3.crate 35961 bytes
DIST pyo3-ffi-0.26.0.crate 78247 bytes
DIST pyo3-ffi-0.28.3.crate 80881 bytes
DIST pyo3-macros-0.26.0.crate 8906 bytes
DIST pyo3-macros-0.28.3.crate 8963 bytes
DIST pyo3-macros-backend-0.26.0.crate 81809 bytes
DIST pyo3-macros-backend-0.28.3.crate 88063 bytes
DIST quote-1.0.45.crate 31564 bytes
DIST regex-1.12.3.crate 153392 bytes
DIST regex-automata-0.4.14.crate 618012 bytes
DIST regex-syntax-0.8.10.crate 358781 bytes
DIST rustc-hash-2.1.1.crate 14154 bytes
DIST rustc-hash-2.1.2.crate 14754 bytes
DIST rustversion-1.0.22.crate 21096 bytes
DIST serde-1.0.228.crate 83652 bytes
DIST serde_core-1.0.228.crate 63111 bytes
DIST serde_derive-1.0.228.crate 59605 bytes
DIST syn-2.0.117.crate 306011 bytes
DIST target-lexicon-0.13.5.crate 26928 bytes
DIST tiktoken-0.12.0.tar.gz 37806 bytes
DIST tiktoken-0.13.0.tar.gz 38986 bytes
DIST unicode-ident-1.0.24.crate 49298 bytes
DIST unindent-0.2.4.crate 7422 bytes