vLLM
/
vllm
mirror of https://github.com/vllm-project/vllm.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
vllm/docs/source/api/inference_params.md

281 B
Raw Blame History

Inference Parameters

Inference parameters for vLLM APIs.

(sampling-params)=

Sampling Parameters

.. autoclass:: vllm.SamplingParams
    :members:

(pooling-params)=

Pooling Parameters

.. autoclass:: vllm.PoolingParams
    :members: