OpenVINO™ is an open-source toolkit for optimizing and deploying AI inference
GPT4All: Run Local LLMs on Any Device. Open-source and available for commercial use.
AICI: Prompts as (Wasm) Programs