Community maintained hardware plugin for vLLM on Ascend
Updated 2025-07-20 16:30:47 +08:00
A high-throughput and memory-efficient inference and serving engine for LLMs
Updated 2025-07-04 16:00:34 +08:00