Authoritative Scope: package_scoped |
Distinct Packages: 1 |
Repository Package Instances: 1
euse -i ifevaleuse -E ifevaleuse -D ifeval| Package | Source Kind | Source File | Description |
|---|---|---|---|
| sci-ml/lm-eval | metadata.xml |
sci-ml/lm-eval/metadata.xml |
Enable instruction-following evaluation tasks (leaderboard_ifeval and friends) — checks generated text against structural constraints like length limits, language hints, and required keywords. Auto-downloads the NLTK punkt_tab tokenizer at task-load time (not deferred until eval); seed ~/nltk_data ahead of time on offline hosts. |
| Package | Observations | Versions | Local Description (use.local.desc) | Metadata Description (metadata.xml) |
|---|---|---|---|---|
| sci-ml/lm-eval | IUSE | 0.4.12, 0.4.13 | - | Enable instruction-following evaluation tasks (leaderboard_ifeval and friends) — checks generated text against structural constraints like length limits, language hints, and required keywords. Auto-downloads the NLTK punkt_tab tokenizer at task-load time (not deferred until eval); seed ~/nltk_data ahead of time on offline hosts. |