GPT4All: Run Local LLMs on Any Device. Open-source and available for commercial use.
A beautiful coding agent in your terminal, running on any model you choose - built by the community, for the community ⚒
LLM inference with 7x longer context. Pure C, zero dependencies. Lossless KV cache compression + single-header library.
AICI: Prompts as (Wasm) Programs
OpenVINO™ is an open source toolkit for optimizing and deploying AI inference