A high-throughput and memory-efficient inference and serving engine for LLMs
OpenVINO™ is an open-source toolkit for optimizing and deploying AI inference
Port of OpenAI’s Whisper model in C/C++
Faster Whisper transcription with CTranslate2
TypeDB: the power of programming, in your database
AICI: Prompts as (Wasm) Programs
