sci-ml/fastflowlm (stuff)

Search

Install

Install this package:

emerge -a sci-ml/fastflowlm

Package Information

Description:
FastFlowLM (FLM) is a lightweight LLM inference runtime purpose-built for AMD Ryzen AI NPUs (XDNA2 architecture). It provides an Ollama-style CLI and OpenAI-compatible server API for running language models entirely on the NPU with no GPU or CPU compute required. Supported hardware: Ryzen AI 300-series (Strix Point, Strix Halo), 400-series (Gorgon Point), and Z2 Extreme. XDNA1 (Ryzen AI 7000/8000) is NOT supported. The orchestration code and CLI are MIT-licensed. NPU compute kernels (xclbins) are proprietary binaries, free for commercial use under $10M annual company revenue.
Homepage:
https://fastflowlm.com/ https://github.com/FastFlowLM/FastFlowLM
License:
MIT FastFlowLM-Binary

Versions

Version EAPI Keywords Slot
9999 8 0
0.9.43-r1 8 ~amd64 0
0.9.42-r1 8 ~amd64 0
0.9.41-r1 8 ~amd64 0
0.9.40-r1 8 ~amd64 0

Metadata

Description

Maintainers

Upstream

Raw Metadata XML
<pkgmetadata>
	<maintainer type="person">
		<email>iohann.s.titov@gmail.com</email>
		<name>Ivan S. Titov</name>
	</maintainer>
	<longdescription lang="en">
		FastFlowLM (FLM) is a lightweight LLM inference runtime purpose-built
		for AMD Ryzen AI NPUs (XDNA2 architecture). It provides an Ollama-style
		CLI and OpenAI-compatible server API for running language models entirely
		on the NPU with no GPU or CPU compute required.

		Supported hardware: Ryzen AI 300-series (Strix Point, Strix Halo),
		400-series (Gorgon Point), and Z2 Extreme. XDNA1 (Ryzen AI 7000/8000)
		is NOT supported.

		The orchestration code and CLI are MIT-licensed. NPU compute kernels
		(xclbins) are proprietary binaries, free for commercial use under
		$10M annual company revenue.
	</longdescription>
	<use>
		<flag name="openrc">Install OpenRC init.d/conf.d files for a supervise-daemon-managed service</flag>
		<flag name="systemd">Install a systemd template service unit (fastflowlm@.service)</flag>
	</use>
	<upstream>
		<doc>https://fastflowlm.com/docs/</doc>
		<bugs-to>https://github.com/FastFlowLM/FastFlowLM/issues</bugs-to>
		<remote-id type="github">FastFlowLM/FastFlowLM</remote-id>
	</upstream>
</pkgmetadata>

Lint Warnings

USE Flags

Manage flags for this package: euse -i <flag> -p sci-ml/fastflowlm | euse -E <flag> -p sci-ml/fastflowlm | euse -D <flag> -p sci-ml/fastflowlm

Flag Description 9999 0.9.43-r1 0.9.42-r1 0.9.41-r1 0.9.40-r1
openrc Install OpenRC init.d/conf.d files for a supervise-daemon-managed service
systemd Install a systemd template service unit (fastflowlm@.service)

Files

Manifest

Type File Size Versions
DIST msgpack-c-092bc69b6e815980bce7808595c914dd3a29f905.tar.gz 476163 bytes 0.9.43-r1, 0.9.42-r1, 0.9.41-r1, 0.9.40-r1
DIST sentencepiece-11051e3b73b3a6222a52acd720e39805dc7545ab.tar.gz 13487870 bytes 0.9.43-r1, 0.9.42-r1, 0.9.41-r1, 0.9.40-r1
DIST tokenizers-cpp-34885cfd7b9ef27b859c28a41e71413dd31926f5.tar.gz 39707 bytes 0.9.42-r1, 0.9.41-r1
DIST tokenizers-cpp-acbdc5a27ae01ba74cda756f94da698d40f11dfe.tar.gz 39758 bytes 0.9.43-r1, 0.9.40-r1
Unmatched Entries
Type File Size
DIST fastflowlm-0.9.40.tar.gz 119072212 bytes
DIST fastflowlm-0.9.41.tar.gz 119071744 bytes
DIST fastflowlm-0.9.42.tar.gz 119075477 bytes
DIST fastflowlm-0.9.43.tar.gz 119151213 bytes