Install this version:
emerge -a =dev-python/curated-tokenizers-2.0.0If this version is masked, you can unmask it using the autounmask tool or standard emerge options:
autounmask =dev-python/curated-tokenizers-2.0.0Or alternatively:
emerge --autounmask-write -a =dev-python/curated-tokenizers-2.0.0| Version | EAPI | Keywords | Slot |
|---|---|---|---|
| 2.0.0 | 8 | ~amd64 | 0 |
# Copyright 2025 Gentoo Authors
# Distributed under the terms of the GNU General Public License v2
EAPI=8
PYTHON_COMPAT=( python3_{10..15} )
DISTUTILS_USE_PEP517=setuptools
inherit distutils-r1
DESCRIPTION="Lightweight piece tokenization library."
HOMEPAGE="https://github.com/explosion/curated-tokenizers"
SRC_URI="https://github.com/explosion/${PN}/archive/refs/tags/v${PV}.tar.gz -> ${P}.tar.gz"
PATCHES=(
"${FILESDIR}/${P}-system-deps.patch"
"${FILESDIR}/${PN}-system-headers.patch"
)
LICENSE="MIT"
SLOT="0"
KEYWORDS="~amd64"
RDEPEND=">=dev-python/regex-2022[${PYTHON_USEDEP}]
dev-cpp/abseil-cpp
dev-libs/protobuf
sci-ml/sentencepiece"
EPYTEST_PLUGINS=()
distutils_enable_tests pytest
>=dev-python/regex-2022[] dev-cpp/abseil-cpp dev-libs/protobuf sci-ml/sentencepiece
| Type | File | Size | Source URLs |
|---|---|---|---|
| DIST | curated-tokenizers-2.0.0.tar.gz | 204950 bytes | https://github.com/explosion/curated-tokenizers/archive/refs/tags/v2.0.0.tar.gz |