sci-ml/fastflowlm::inode64-overlay
- Ebuilds: 1, Snapshot: 9999 Description:
FastFlowLM (FLM) is a lightweight LLM inference runtime purpose-built for AMD Ryzen AI NPUs
(XDNA2 architecture). It provides an Ollama-style CLI and an OpenAI-compatible server API for
running language models entirely on the NPU. Supported hardware: Ryzen AI 300-series (Strix
Point, Strix Halo), 400-series (Gorgon Point) and Z2 Extreme. XDNA1 (Ryzen AI 7000/8000) is
not supported. The CLI is MIT licensed; the NPU compute kernels are proprietary binaries.
Homepage:
https://fastflowlm.com/
https://github.com/ROCm/FastFlowLM
License: MIT FastFlowLM-Terms
sci-ml/lemonade::inode64-overlay
- Ebuilds: 1, Snapshot: 9999 Description:
Lemonade is a local AI server that exposes optimized LLMs through OpenAI, Anthropic and Ollama
compatible APIs, running inference on AMD NPU and GPU. The C++ server core (lemond, lemonade)
is packaged; the bundled web frontend is available behind USE=webui and the Tauri desktop
wrapper behind USE=tauri. Pairs with sci-ml/fastflowlm to drive the AMD Ryzen AI XDNA2 NPU.
Homepage:
https://lemonade-server.ai/
https://github.com/lemonade-sdk/lemonade
License: Apache-2.0