KoboldCpp - Run GGUF AI models locally with a KoboldAI UI. One File. Zero Install.
ggml speech-to-text inference for 16+ model families
