A high-throughput and memory-efficient inference and serving engine for LLMs
Run GGUF models easily with a KoboldAI UI. One File. Zero Install.
Get up and running with Kimi-K2.6, GLM-5.1, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.
aider is AI pair programming in your terminal
Tools for merging pretrained large language models.
[NeurIPS'23 Oral] Visual Instruction Tuning (LLaVA) built towards GPT-4V level capabilities and beyond.
SOTA Open Source TTS
LocalAI is the open-source AI engine. Run any model - LLMs, vision, voice, image, video - on any hardware. No GPU required.
Interface for OuteTTS models.
Go with your own intelligence - Go applications that directly integrate llama.cpp for local inference using hardware acceleration.
Maid is a free and open source application for interfacing with llama.cpp models locally, and with Anthropic, DeepSeek, Ollama, Mistral and OpenAI models remotely.
A self-hosted, offline, ChatGPT-like chatbot. Powered by Llama 2. 100% private, with no data leaving your device. New: Code Llama support!
H2O LLM Studio - a framework and no-code GUI for fine-tuning LLMs. Documentation: https://docs.h2o.ai/h2o-llmstudio/
A font for writing tiny stories
A simple github actions script to build a llamafile and uploads to huggingface
