sci-ml/localai (bentoo)

Search

Install

Install this package:

emerge -a sci-ml/localai

Package Information

Description:
LocalAI serves local models over an OpenAI-compatible HTTP API, so any client written against that API can talk to a model on this machine instead of a hosted service. It also ships a browser UI, compiled into the binary, for browsing the model gallery and chatting without a separate client. No acceleration backend is compiled in, and that is upstream's design rather than a limitation of this ebuild: LocalAI resolves its inference backends — llama.cpp, whisper.cpp, diffusers, and the rest — as OCI artifacts fetched at RUNTIME, choosing one that matches the hardware it finds. A CPU-only install is therefore the default and needs nothing extra, and nobody has to pull in CUDA or ROCm to run this package. That is why this package has no USE flags and no accelerator dependencies. The build reaches no network. Upstream's Makefile makes three fetches: it downloads a prebuilt protoc, runs `go install ...@version` twice for the two protobuf code generators, and runs `npm install` for the React UI. All three are replaced here. protoc comes from dev-libs/protobuf. protoc-gen-go is built from LocalAI's own vendored sources, so the generator matches the protobuf runtime the binary links against, and protoc-gen-go-grpc — which is a separate Go module and so never reachable through vendoring — is built from a small bundle of its own. The React UI's node_modules and the Go dependencies both arrive as distfiles, so every input to the build is recorded in the Manifest.
Homepage:
https://localai.io/ https://github.com/mudler/LocalAI
License:
MIT Apache-2.0 BSD BSD-2 ISC MPL-2.0

Versions

Version EAPI Keywords Slot
4.9.0 8 ~amd64 ~arm64 0

Metadata

Description

Maintainers

Upstream

Raw Metadata XML
<pkgmetadata>
	<maintainer type="person">
		<email>lucascs@proton.me</email>
		<name>Lucas C.S.</name>
	</maintainer>
	<longdescription lang="en">
		LocalAI serves local models over an OpenAI-compatible HTTP API, so any
		client written against that API can talk to a model on this machine
		instead of a hosted service. It also ships a browser UI, compiled into
		the binary, for browsing the model gallery and chatting without a
		separate client.

		No acceleration backend is compiled in, and that is upstream's design
		rather than a limitation of this ebuild: LocalAI resolves its inference
		backends — llama.cpp, whisper.cpp, diffusers, and the rest — as OCI
		artifacts fetched at RUNTIME, choosing one that matches the hardware it
		finds. A CPU-only install is therefore the default and needs nothing
		extra, and nobody has to pull in CUDA or ROCm to run this package. That
		is why this package has no USE flags and no accelerator dependencies.

		The build reaches no network. Upstream's Makefile makes three fetches:
		it downloads a prebuilt protoc, runs `go install ...@version` twice for
		the two protobuf code generators, and runs `npm install` for the React
		UI. All three are replaced here. protoc comes from dev-libs/protobuf.
		protoc-gen-go is built from LocalAI's own vendored sources, so the
		generator matches the protobuf runtime the binary links against, and
		protoc-gen-go-grpc — which is a separate Go module and so never
		reachable through vendoring — is built from a small bundle of its own.
		The React UI's node_modules and the Go dependencies both arrive as
		distfiles, so every input to the build is recorded in the Manifest.
	</longdescription>
	<upstream>
		<changelog>https://github.com/mudler/LocalAI/releases</changelog>
		<doc>https://localai.io/docs/</doc>
		<bugs-to>https://github.com/mudler/LocalAI/issues</bugs-to>
		<remote-id type="github">mudler/LocalAI</remote-id>
	</upstream>
</pkgmetadata>

Lint Warnings

Files

Manifest

Type File Size Versions
DIST LocalAI-v4.9.0-source.tar.gz 26097714 bytes 4.9.0
DIST localai-4.9.0-vendor.tar.xz 30475172 bytes 4.9.0
DIST localai-react-ui-node_modules-4.9.0.tar.xz 49366132 bytes 4.9.0
DIST protoc-gen-go-grpc-1.4.0-vendor.tar.xz 202496 bytes 4.9.0
Unmatched Entries
Type File Size