Gentoo Packages

Search

Install

Install this package:

emerge -a localai-backend/ik-llama-cpp

Package Information

Description:

LocalAI text-generation backend (ik_llama.cpp gRPC server)

Versions

Metadata

Maintainers

• Plamen K. Kosseff (plamen@ipnmod.org) - Type: person

Upstream

• Remote IDs:
  • github: mudler/LocalAI
  • github: ikawrakow/ik_llama.cpp

<pkgmetadata>
	<maintainer type="person">
		<email>plamen@ipnmod.org</email>
		<name>Plamen K. Kosseff</name>
	</maintainer>
	<use>
		<flag name="native">Let the bundled ggml library auto-detect the build host's CPU features (-march=native) instead of relying on CFLAGS</flag>
		<flag name="openblas">CPU BLAS acceleration via <pkg>sci-libs/openblas</pkg></flag>
		<flag name="rocm">GPU acceleration on AMD via ROCm/HIP</flag>
		<flag name="vulkan">GPU acceleration via Vulkan</flag>
	</use>
	<upstream>
		<remote-id type="github">mudler/LocalAI</remote-id>
		<remote-id type="github">ikawrakow/ik_llama.cpp</remote-id>
	</upstream>
</pkgmetadata>

Lint Warnings

• [Warning] Ebuild 4.12.1 has a line exceeding 80 positions on line 33.
• [Error] Ebuild 4.12.1 does not specify LICENSE
• [Warning] Ebuild 4.12.1 is missing HOMEPAGE
• [Warning] Ebuild 4.12.1 is missing the SLOT variable.
• [Error] Manifest entry for unused DIST file 'localai-4.12.1.tar.gz'
• [Notice] Package has only unstable keywords for arch(es): [ amd64 ], all versions are unstable: [ 4.12.1 ]
• Note: category 'localai-backend' is not in the main gentoo categories list

Files

• ik-llama-cpp-4.12.1-hip-vsub2.patch

Manifest