OpenVINO™ is an open source toolkit for optimizing and deploying AI inference
GPT4All: Run Local LLMs on Any Device. Open-source and available for commercial use.
AICI: Prompts as (Wasm) Programs