Repositories Users Organizations

Search

Sort

Newest Oldest Alphabetically Reverse alphabetically Recently updated Least recently updated Most stars Fewest stars Most forks Fewest forks

vLLM / vllm

Python 0 0

A high-throughput and memory-efficient inference and serving engine for LLMs

llm mlops pytorch cuda inference llama llm-serving llmops model-serving qwen rocm tpu trainium transformer amd xpu deepseek gpt hpu inferentia

Updated 2025-07-04 16:00:34 +08:00