vllm/docs/source/api/offline_inference/llm_inputs.md

315 B

LLM Inputs

.. autodata:: vllm.inputs.PromptType
.. autoclass:: vllm.inputs.TextPrompt
    :show-inheritance:
    :members:
    :member-order: bysource
.. autoclass:: vllm.inputs.TokensPrompt
    :show-inheritance:
    :members:
    :member-order: bysource