ggml speech-to-text inference for 16+ model families
Interface for OuteTTS models.
KoboldCpp - Run GGUF AI models locally with a KoboldAI UI. One File. Zero Install.
Go with your own intelligence - Write Go applications that directly integrate llama.cpp for local inference using hardware acceleration on Linux, macOS, Windows, & WebAssembly.
Maid is a free and open source application for interfacing with llama.cpp models locally, and with Anthropic, DeepSeek, Ollama, Mistral and OpenAI models remotely.
LLM inference with 7x longer context. Pure C, zero dependencies. Lossless KV cache compression + single-header library.
