vLLM
/
vllm-project.github.io
mirror of https://github.com/vllm-project/vllm-project.github.io.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity

Update figure size for aibrix release blog (#36) 

Signed-off-by: Jiaxin Shan <seedjeffwan@gmail.com>
This commit is contained in:
Jiaxin Shan 2025-02-21 14:31:58 -08:00 committed by GitHub
parent 2c056850c0
commit 57e3d78db2
No known key found for this signature in database
GPG Key ID: B5690EEEBB952194
1 changed files with 2 additions and 2 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

4
_posts/2025-02-21-aibrix-release.md
View File

@ -5,11 +5,11 @@ author: "AIBrix Team"
image: /assets/logos/vllm-logo-only-light.png
---
Today, we are excited to announce [vllm-project/AIBrix](https://github.com/vllm-project/aibrix): a battery-included vLLM Kubernetes serving stack developed by Bytedance. Started in early 2024, AIBrix has been successfully deployed to support multiple business use cases across ByteDance, demonstrating its scalability and effectiveness in large-scale deployments.
Today, we are excited to announce [vllm-project/aibrix](https://github.com/vllm-project/aibrix): a battery-included vLLM Kubernetes serving stack developed by Bytedance. Started in early 2024, AIBrix has been successfully deployed to support multiple business use cases across ByteDance, demonstrating its scalability and effectiveness in large-scale deployments.
While vLLM makes deploying a single serving instance easy, deploying vLLM at scale presents unique challenges in routing, autoscaling, and fault tolerance. AIBrix is an open-source initiative designed to provide the essential building blocks to construct scalable inference infrastructure. It delivers a cloud-native solution optimized for deploying, managing, and scaling large language model (LLM) inference, tailored specifically to enterprise needs.
<figure>
<figure style="width: 50%; height: auto; text-align: center; margin: 0 auto;">
<img src="/assets/figures/aibrix/aibrix-diagram.png" />
</figure>