LLM inference in C/C++
[Unmaintained, see README] An ecosystem of Rust libraries for working with large language models
Run GGUF models easily with a KoboldAI UI. One File. Zero Install.
Whisper Dart is a cross platform library for dart and flutter that allows converting audio to text / speech to text / inference from Open AI models
