vLLM
/
vllm-project.github.io
mirror of https://github.com/vllm-project/vllm-project.github.io.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity

Update _posts/2023-11-14-notes-vllm-vs-deepspeed.md 

Co-authored-by: Zhuohan Li <zhuohan123@gmail.com>
This commit is contained in:
Woosuk Kwon 2023-11-14 12:45:32 -08:00 committed by GitHub
parent a0f139a454
commit 5232941cfe
No known key found for this signature in database
GPG Key ID: 4AEE18F83AFDEB23
1 changed files with 1 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
_posts/2023-11-14-notes-vllm-vs-deepspeed.md
View File

@ -58,7 +58,7 @@ Specifically for the Dynamic SplitFuse optimization, we are actively investigati
### Appendix: Feature Comparison ### Appendix: Feature Comparison
DeepSpeed currently offers basic functionalities, supporting only three model types and lacking popular features like stop strings and parallel sampling (beam search). DeepSpeed currently offers basic functionalities, supporting only three model types and lacking popular features like stop strings and parallel sampling (e.g., beam search).
We do expect the DeepSpeed open source are eager to catch up and we welcome the creative innovation in the market! We do expect the DeepSpeed open source are eager to catch up and we welcome the creative innovation in the market!
| | vLLM | DeepSpeed | | | vLLM | DeepSpeed |