Authoritative Scope: package_scoped |
Distinct Packages: 1 |
Repository Package Instances: 1
euse -i onnxruntimeeuse -E onnxruntimeeuse -D onnxruntime| Package | Source Kind | Source File | Description |
|---|---|---|---|
| sci-ml/lm-eval | metadata.xml |
sci-ml/lm-eval/metadata.xml |
Enable the raw ONNX Runtime model backend (<pkg>sci-libs/onnxruntime</pkg> built with USE=python), scoring a Model Builder ONNX export through a plain InferenceSession. Reaches execution providers the onnxruntime-genai backend does not build, notably ROCm and MIGraphX. Implements the log-likelihood path only — loglikelihood, multiple_choice and loglikelihood_rolling tasks; generative tasks are not supported yet. |
| Package | Observations | Versions | Local Description (use.local.desc) | Metadata Description (metadata.xml) |
|---|---|---|---|---|
| sci-ml/lm-eval | IUSE | 0.4.13 | - | Enable the raw ONNX Runtime model backend (<pkg>sci-libs/onnxruntime</pkg> built with USE=python), scoring a Model Builder ONNX export through a plain InferenceSession. Reaches execution providers the onnxruntime-genai backend does not build, notably ROCm and MIGraphX. Implements the log-likelihood path only — loglikelihood, multiple_choice and loglikelihood_rolling tasks; generative tasks are not supported yet. |