vllm/docs/models/extensions/fastsafetensor.md

Loading Model weights with fastsafetensors

Using fastsafetensors library enables loading model weights to GPU memory by leveraging GPU direct storage. See their GitHub repository for more details. For enabling this feature, set the environment variable USE_FASTSAFETENSOR to true