83f99c54ce
* update CI script Signed-off-by: Chendi Xue <chendi.xue@intel.com> * clean up Signed-off-by: Chendi Xue <chendi.xue@intel.com> --------- Signed-off-by: Chendi Xue <chendi.xue@intel.com> |
||
|---|---|---|
| .github/workflows | ||
| docs | ||
| examples | ||
| tests | ||
| tools | ||
| vllm_hpu | ||
| .gitignore | ||
| .pre-commit-config.yaml | ||
| README.md | ||
| format.sh | ||
| mkdocs.yaml | ||
| pyproject.toml | ||
| requirements-docs.txt | ||
| requirements-lint.txt | ||
| requirements.txt | ||
| setup.py | ||
README.md
[!IMPORTANT]
This is an early developer preview of the vLLM Gaudi Plugin and is not yet intended for general use. For a more stable experience, consider using the HabanaAI/vllm-fork or the in-tree Gaudi implementation available in vllm-project/vllm.
Welcome to vLLM x Intel Gaudi
x
vLLM Gaudi plugin (vllm-gaudi) integrates Intel Gaudi accelerators with vLLM to optimize large language model inference.
This plugin follows the [RFC]: Hardware pluggable and [RFC]: Enhancing vLLM Plugin Architecture principles, providing a modular interface for Intel Gaudi hardware.
Learn more: