mirror of https://github.com/vllm-project/vllm.git
462 B
462 B
| title |
|---|
| NVIDIA Triton |
{ #deployment-triton }
The Triton Inference Server hosts a tutorial demonstrating how to quickly deploy a simple facebook/opt-125m model using vLLM. Please see Deploying a vLLM model in Triton for more details.