bitnet
- Ebuilds: 1, Snapshot: 9999 Description:
BitNet is the official inference framework for 1-bit LLMs (BitNet b1.58).
It provides optimized kernels for fast and lossless inference of 1.58-bit
quantized models on CPU, with architecture-specific optimizations for
x86 (TL2) and ARM (TL1) platforms.
Homepage:https://github.com/microsoft/BitNet License: MIT
gaia
- Ebuilds: 2, Testing: 0.17.6-r1 Description:
AMD Gaia is an AI agent framework that provides tools for building
and deploying AI agents. It includes support for various AI models
and frameworks, with integration for AMD hardware acceleration.
Homepage:https://github.com/amd/gaia License: MIT
lemonade
- Ebuilds: 7, Testing: 10.6.0 Description:
Lemonade is a local LLM inference platform built on the Lemonade SDK.
It provides a server daemon (lemond), a command-line client, and an
optional web interface. Supports multiple backends including CUDA,
OpenCL, and Vulkan for efficient model deployment.
Homepage:https://github.com/lemonade-sdk/lemonade License: Apache-2.0