A high-throughput and memory-efficient inference and serving engine for LLMs
🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.
Port of OpenAI’s Whisper model in C/C++
Translate manga/image 一键翻译各类图片内文字 https://cotrans.touhou.ai/ (no longer working)
SOTA Open Source TTS
Faster Whisper transcription with CTranslate2
Pre-trained Neural Network models in Axon (+ 🤗 Models integration)
AICI: Prompts as (Wasm) Programs
