LLM inference in C/C++
Run GGUF models easily with a KoboldAI UI. One File. Zero Install.
[Unmaintained, see README] An ecosystem of Rust libraries for working with large language models
