USE Flag: ifeval

Provenance Summary

Authoritative Scope: package_scoped | Distinct Packages: 1 | Repository Package Instances: 1

Search

Manage

Package-Scoped Descriptions (use.local.desc / metadata.xml)

Package Source Kind Source File Description
sci-ml/lm-eval metadata.xml sci-ml/lm-eval/metadata.xml Enable instruction-following evaluation tasks (leaderboard_ifeval and friends) — checks generated text against structural constraints like length limits, language hints, and required keywords. Auto-downloads the NLTK punkt_tab tokenizer at task-load time (not deferred until eval); seed ~/nltk_data ahead of time on offline hosts.

Package Usage Occurrences

Package Observations Versions Local Description (use.local.desc) Metadata Description (metadata.xml)
sci-ml/lm-eval IUSE 0.4.12, 0.4.13 - Enable instruction-following evaluation tasks (leaderboard_ifeval and friends) — checks generated text against structural constraints like length limits, language hints, and required keywords. Auto-downloads the NLTK punkt_tab tokenizer at task-load time (not deferred until eval); seed ~/nltk_data ahead of time on offline hosts.