sci-ml/strata::ruizhi-overlay
- Ebuilds: 1, Testing: 0.2.18 Description:
Strata is an inference engine for Qwen3.8-Flash-Next (and, in the terminal's
catalogue, Tencent Hy4-Flash) on consumer NVIDIA and AMD hardware, with an
OpenAI/Anthropic-compatible API served on localhost and a terminal client
that picks, verifies and starts the engine.
The engine built here runs Qwen3.8-Flash-Next: its catalogue lists that model
in several GSQ-RCO, Q2_0 and UD quantizations, and the terminal refuses other
GGUF files, including other Qwen3.8 sizes. The catalogue also lists
Tencent Hy4-Flash, whose model files the terminal can prepare, but each Hy4
engine is the separate upstream component strata-hy4 that this package does
not build.
The engine is built for one GPU backend (CUDA or ROCm HIP) and installed as
an engine component that the terminal verifies against a SHA-256 manifest at
every start.
Homepage:https://github.com/Niko1221/Strata License: MIT