Gentoo Packages

Search

Install

Install this package:

emerge -a sci-ml/fastflowlm

Package Information

Description:

FastFlowLM (FLM) is a lightweight LLM inference runtime purpose-built for AMD Ryzen AI NPUs (XDNA2 architecture). It provides an Ollama-style CLI and OpenAI-compatible server API for running language models entirely on the NPU with no GPU or CPU compute required. Supported hardware: Ryzen AI 300-series (Strix Point, Strix Halo), 400-series (Gorgon Point), and Z2 Extreme. XDNA1 (Ryzen AI 7000/8000) is NOT supported. The orchestration code and CLI are MIT-licensed. NPU compute kernels (xclbins) are proprietary binaries, free for commercial use under $10M annual company revenue.

Homepage:

https://fastflowlm.com/ https://github.com/FastFlowLM/FastFlowLM

License:

MIT FastFlowLM-Binary

Versions

Metadata

Description

• FastFlowLM (FLM) is a lightweight LLM inference runtime purpose-built for AMD Ryzen AI NPUs (XDNA2 architecture). It provides an Ollama-style CLI and OpenAI-compatible server API for running language models entirely on the NPU with no GPU or CPU compute required. Supported hardware: Ryzen AI 300-series (Strix Point, Strix Halo), 400-series (Gorgon Point), and Z2 Extreme. XDNA1 (Ryzen AI 7000/8000) is NOT supported. The orchestration code and CLI are MIT-licensed. NPU compute kernels (xclbins) are proprietary binaries, free for commercial use under $10M annual company revenue.

Maintainers

• Ivan S. Titov (iohann.s.titov@gmail.com) - Type: person

Upstream

• Bugs: https://github.com/FastFlowLM/FastFlowLM/issues
• Remote IDs:
  • github: FastFlowLM/FastFlowLM

<pkgmetadata>
	<maintainer type="person">
		<email>iohann.s.titov@gmail.com</email>
		<name>Ivan S. Titov</name>
	</maintainer>
	<longdescription lang="en">
    FastFlowLM (FLM) is a lightweight LLM inference runtime purpose-built
    for AMD Ryzen AI NPUs (XDNA2 architecture). It provides an Ollama-style
    CLI and OpenAI-compatible server API for running language models entirely
    on the NPU with no GPU or CPU compute required.

    Supported hardware: Ryzen AI 300-series (Strix Point, Strix Halo),
    400-series (Gorgon Point), and Z2 Extreme. XDNA1 (Ryzen AI 7000/8000)
    is NOT supported.

    The orchestration code and CLI are MIT-licensed. NPU compute kernels
    (xclbins) are proprietary binaries, free for commercial use under
    $10M annual company revenue.
  </longdescription>
	<use>
		<flag name="openrc">Install OpenRC init.d/conf.d files for a supervise-daemon-managed service</flag>
		<flag name="systemd">Install a systemd template service unit (fastflowlm@.service)</flag>
	</use>
	<upstream>
		<doc>https://fastflowlm.com/docs/</doc>
		<bugs-to>https://github.com/FastFlowLM/FastFlowLM/issues</bugs-to>
		<remote-id type="github">FastFlowLM/FastFlowLM</remote-id>
	</upstream>
</pkgmetadata>

Lint Warnings

• [Error] Missing md5-cache for ebuild fastflowlm-9999
• [Error] Missing md5-cache for ebuild fastflowlm-0.9.43-r1
• [Error] Missing md5-cache for ebuild fastflowlm-0.9.42-r1

USE Flags

Manage flags for this package: euse -i <flag> -p sci-ml/fastflowlm | euse -E <flag> -p sci-ml/fastflowlm | euse -D <flag> -p sci-ml/fastflowlm

Files

• fastflowlm.confd
• fastflowlm.initd
• fastflowlm.service
• flm-patch-whisper

Manifest