sci-ml/bitnet::bennypowers
- Ebuilds: 1, Snapshot: 9999 Description:
BitNet is the official inference framework for 1-bit LLMs (BitNet b1.58).
It provides optimized kernels for fast and lossless inference of 1.58-bit
quantized models on CPU, with architecture-specific optimizations for
x86 (TL2) and ARM (TL1) platforms.
Homepage:https://github.com/microsoft/BitNet License: MIT
sci-ml/gaia::bennypowers
- Ebuilds: 5, Testing: 0.21.2 Description:
AMD Gaia is an AI agent framework that provides tools for building
and deploying AI agents. It includes support for various AI models
and frameworks, with integration for AMD hardware acceleration.
Homepage:https://github.com/amd/gaia License: MIT
sci-ml/kokoro-onnx::bennypowers
- Ebuilds: 1, Testing: 0.5.0 Description:
kokoro-onnx provides local text-to-speech using the Kokoro-82M
neural TTS model via ONNX Runtime. Supports multiple languages
and voices with CPU inference by default. GPU acceleration is
available via the ONNX_PROVIDER environment variable when
onnxruntime is built with CUDA or MIGraphX support.
Homepage:https://github.com/thewh1teagle/kokoro-onnx License: MIT
sci-ml/lemonade::bennypowers
- Ebuilds: 13, Testing: 10.9.0 Description:
Lemonade is a local LLM inference platform built on the Lemonade SDK.
It provides a server daemon (lemond), a command-line client, and an
optional web interface. Supports multiple backends including CUDA,
OpenCL, and Vulkan for efficient model deployment.
Homepage:https://github.com/lemonade-sdk/lemonade License: Apache-2.0