Run GGUF models easily with a KoboldAI UI. One File. Zero Install.
Maid is a cross-platform Flutter app for interfacing with GGUF / llama.cpp models locally, and with Ollama and OpenAI models remotely.