Gentoo Packages

Category: sci-misc

• llama-cpp - Ebuilds: 3, Testing: 0_pre9413, Snapshot: 9999
  Description: Port of Facebook's LLaMA model in C/C++
  Homepage: https://github.com/ggml-org/llama.cpp
  License: MIT
• llama-swap - Ebuilds: 1, Testing: 217
  Description: llama-swap is an OpenAI/Anthropic-compatible HTTP proxy that starts and stops local LLM inference servers (llama.cpp, vllm, mlx-server, etc.) on demand based on the requested model. Lets a single API endpoint serve many models without keeping them all resident in GPU/NPU memory.
  Homepage: https://github.com/mostlygeek/llama-swap
  License: MIT