Gentoo Packages

dev-python/youtokentome - 1.0.7 (pentoo)

Search

Install

Install this version:

emerge -a =dev-python/youtokentome-1.0.7

Package Information

Description:
Unsupervised text tokenizer focused on computational efficiency
Homepage:
https://github.com/vkcom/youtokentome
License:
MIT

Ebuild Details

Version EAPI Keywords Slot
1.0.7 8 amd64 ~arm64 x86 0
View Raw Ebuild 
# Copyright 1999-2025 Gentoo Authors
# Distributed under the terms of the GNU General Public License v2

EAPI=8

DISTUTILS_USE_PEP517=setuptools
DISTUTILS_EXT=1
PYTHON_COMPAT=( python3_{12..14} )

inherit distutils-r1

DESCRIPTION="Unsupervised text tokenizer focused on computational efficiency"
HOMEPAGE="https://github.com/vkcom/youtokentome"
SRC_URI="https://github.com/VKCOM/YouTokenToMe/archive/refs/tags/v${PV}.tar.gz -> ${P}.gh.tar.gz"

S="${WORKDIR}/YouTokenToMe-${PV}"

LICENSE="MIT"
SLOT="0"
KEYWORDS="amd64 ~arm64 x86"
IUSE="test"
RESTRICT="!test? ( test )"

PATCHES=(
	"${FILESDIR}/${P}-fix-test.patch"
)

RDEPEND="
	dev-python/click[${PYTHON_USEDEP}]
"
BDEPEND="
	${RDEPEND}
	dev-python/cython[${PYTHON_USEDEP}]
	test? (
		dev-python/tabulate[${PYTHON_USEDEP}]
		sci-ml/tokenizers
	)
"

distutils_enable_tests pytest

USE Flags

Manage flags for this package: euse -i <flag> -p dev-python/youtokentome | euse -E <flag> -p dev-python/youtokentome | euse -D <flag> -p dev-python/youtokentome

Global/Standard Flags

test

Inherited Eclasses

distutils-r1

Dependencies

RDEPEND

	dev-python/click[]

BDEPEND

	
	dev-python/click[]

	dev-python/cython[]
	test? (
		dev-python/tabulate[]
		sci-ml/tokenizers
	)

Manifest for 1.0.7

Type File Size Source URLs
DIST youtokentome-1.0.7.gh.tar.gz 49480 bytes https://github.com/VKCOM/YouTokenToMe/archive/refs/tags/v1.0.7.tar.gz