A high-throughput and memory-efficient inference and serving engine for LLMs
SOTA Open Source TTS
LocalAI is the open-source AI engine. Run any model - LLMs, vision, voice, image, video - on any hardware. No GPU required.
aider is AI pair programming in your terminal
Interface for OuteTTS models.
Tools for merging pretrained large language models.
KoboldCpp - Run GGUF AI models locally with a KoboldAI UI. One File. Zero Install.
Go with your own intelligence - Write Go applications that directly integrate llama.cpp for local inference using hardware acceleration on Linux, macOS, Windows, & WebAssembly.
Maid is a free and open source application for interfacing with llama.cpp models locally, and with Anthropic, DeepSeek, Ollama, Mistral and OpenAI models remotely.
[NeurIPS'23 Oral] Visual Instruction Tuning (LLaVA) built towards GPT-4V level capabilities and beyond.
H2O LLM Studio - a framework and no-code GUI for fine-tuning LLMs. Documentation: https://docs.h2o.ai/h2o-llmstudio/
A font for writing tiny stories
A simple github actions script to build a llamafile and uploads to huggingface
