A high-throughput and memory-efficient inference and serving engine for LLMs
Faster Whisper transcription with CTranslate2
OpenVINO™ is an open source toolkit for optimizing and deploying AI inference
AICI: Prompts as (Wasm) Programs
TypeDB: Built for systems, not records
