Inference parameters for vLLM APIs.
(sampling-params)=
.. autoclass:: vllm.SamplingParams :members:
(pooling-params)=
.. autoclass:: vllm.PoolingParams :members: