USE Flag: ifeval

Search

Manage

Local and Metadata Descriptions

Metadata Descriptions (metadata.xml)

Packages Using This Flag

Package Local Description (use.local.desc) Metadata Description (metadata.xml)
sci-ml/lm-eval - Enable instruction-following evaluation tasks (leaderboard_ifeval and friends) — checks generated text against structural constraints like length limits, language hints, and required keywords. Auto-downloads the NLTK punkt_tab tokenizer at task-load time (not deferred until eval); seed ~/nltk_data ahead of time on offline hosts.