vLLM
/
vllm-project.github.io
mirror of https://github.com/vllm-project/vllm-project.github.io.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity

Acknowledgement 

Signed-off-by: Yuan Tang <terrytangyuan@gmail.com>
This commit is contained in:
Yuan Tang 2025-01-12 20:56:12 -05:00
parent ff47b6e951
commit 940a264895
No known key found for this signature in database
1 changed files with 5 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

6
_posts/2025-01-12-intro-to-llama-stack-with-vllm.md
View File

@ -392,8 +392,12 @@ kubectl port-forward service/llama-stack-service 5000:5000
llama-stack-client --endpoint http://localhost:5000 inference chat-completion --message "hello, what model are you?" llama-stack-client --endpoint http://localhost:5000 inference chat-completion --message "hello, what model are you?"
``` ```
TODO: More interesting prompt to congratulate reaching the end of the article TODO: More interesting prompt to congratulate reaching the end of the article
TODO(yuan): potential mention of deployment option via KServe
## Acknowledgments ## Acknowledgments
TBA TODO(yuan and ashwin):
* Llama Stack/Meta team (core maintainers)
* Red Hat team (contributors, reviewers)
* vLLM team