vllm/docs/source/api/inference_params.md

281 B

Inference Parameters

Inference parameters for vLLM APIs.

(sampling-params)=

Sampling Parameters

.. autoclass:: vllm.SamplingParams
    :members:

(pooling-params)=

Pooling Parameters

.. autoclass:: vllm.PoolingParams
    :members: