GPT4All: Run Local LLMs on Any Device. Open-source and available for commercial use.
OpenVINO™ is an open source toolkit for optimizing and deploying AI inference
An open coding agent for your terminal, built by a community collective rather than a company. Bring your own model, keep your code on your machine, and owe nothing to anyone.
AICI: Prompts as (Wasm) Programs
LLM inference with 7x longer context. Pure C, zero dependencies. Lossless KV cache compression + single-header library.