caffe2
- Ebuilds: 1, Testing: 2.11.0-r90 Description: A deep learning framework
Homepage:https://pytorch.org/ License: BSD
fastflowlm
- Ebuilds: 4, Testing: 0.9.41 Description:
FastFlowLM (FLM) is a lightweight LLM inference runtime purpose-built
for AMD Ryzen AI NPUs (XDNA2 architecture). It provides an Ollama-style
CLI and OpenAI-compatible server API for running language models entirely
on the NPU with no GPU or CPU compute required.
Supported hardware: Ryzen AI 300-series (Strix Point, Strix Halo),
400-series (Gorgon Point), and Z2 Extreme. XDNA1 (Ryzen AI 7000/8000)
is NOT supported.
The orchestration code and CLI are MIT-licensed. NPU compute kernels
(xclbins) are proprietary binaries, free for commercial use under
$10M annual company revenue.
Homepage:
https://www.fastflowlm.com/
https://github.com/FastFlowLM/FastFlowLM
License: MIT FastFlowLM-Binary
kokoros
- Ebuilds: 1
Description:
Kokoros is a Rust implementation of the Kokoro-82M text-to-speech
model. Provides the `koko` CLI and an OpenAI-compatible HTTP server
used as the kokoro:cpu backend by sci-ml/lemonade.
Tracks upstream lucasjinreal/Kokoros directly. The lemonade-sdk
fork only diverges in CI infrastructure plus a bundled espeak-ng-data
copy that ::gentoo already provides via app-accessibility/espeak-ng,
so source-build users get the same binary either way.
Runtime model files (kokoro-v1.0.onnx + voices-v1.0.bin) are not
bundled — see pkg_postinst for a quick fetch recipe.
Homepage:https://github.com/lucasjinreal/Kokoros License: Apache-2.0
lemonade
- Ebuilds: 2, Testing: 10.3.0 Description:
Lemonade is a local AI server that exposes optimized LLMs through
OpenAI / Anthropic / Ollama compatible APIs, running inference on
AMD NPU and GPU. The C++ server core (lemond, lemonade-server) is
packaged here without the Tauri desktop wrapper or the bundled
web frontend; both are CMake-toggleable and can be added behind
USE flags later if needed.
Pairs with sci-ml/fastflowlm to drive the AMD Ryzen AI XDNA2 NPU
backend.
Homepage:
https://lemonade-server.ai/
https://github.com/lemonade-sdk/lemonade
License: Apache-2.0