vLLM
/
vllm
mirror of https://github.com/vllm-project/vllm.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
6,944 Commits 73 Branches 67 Tags 518 MiB
Commit Graph

1061 Commits

Author SHA1 Message Date
Xu Wenqing 02658c2dfe
Add DeepSeek-R1-0528 function call chat template (#18874) 
Signed-off-by: 许文卿 <xwq391974@alibaba-inc.com>
 2025-06-04 13:24:18 +00:00
Isotr0py 8711bc5e68
[Misc] Add packages for benchmark as extra dependency (#19089) 
Signed-off-by: Isotr0py <2037008807@qq.com>
 2025-06-04 04:18:48 -07:00
Li, Jiang 4555143ea7
[CPU] V1 support for the CPU backend (#16441) 2025-06-03 18:43:01 -07:00
Russell Bryant 52dceb172d
[Docs] Add developer doc about CI failures (#18782) 
Signed-off-by: Russell Bryant <rbryant@redhat.com>
Co-authored-by: Mark McLoughlin <markmc@redhat.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
 2025-06-04 01:09:13 +00:00
Reid 01eee40536
[doc] update docker version (#19074) 
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
 2025-06-03 19:08:21 +00:00
Simon Mo 02f0c7b220
[Misc] Add SPDX-FileCopyrightText (#19100) 
Signed-off-by: simon-mo <simon.mo@hey.com>
 2025-06-03 11:20:17 -07:00
youkaichao 4e88723f32
[doc] clarify windows support (#19088) 
Signed-off-by: youkaichao <youkaichao@gmail.com>
 2025-06-03 21:42:17 +08:00
Cyrus Leung 118ff92111
[Doc] Update V1 user guide for embedding and enc-dec models (#19060) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2025-06-03 02:29:41 -07:00
Jee Jee Li 42243fbda0
[Doc] Add InternVL LoRA support (#19055) 
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
 2025-06-03 09:08:03 +00:00
Michael Goin 6d18ed2a2e
Update docker docs with ARM CUDA cross-compile (#19037) 
Signed-off-by: mgoin <michael@neuralmagic.com>
 2025-06-03 08:21:53 +00:00
Chen Zhang f32fcd9444
[v1][KVCacheManager] Rename BlockHashType to BlockHash (#19015) 
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
 2025-06-03 08:01:48 +00:00
Lu Fang d32aa2e670
[Bugfix] Use cmake 3.26.1 instead of 3.26 to avoid build failure (#19019) 
Signed-off-by: Lu Fang <lufang@fb.com>
 2025-06-03 00:16:17 -07:00
汪志鹏 1282bd812e
Add tarsier model support (#18985) 
Signed-off-by: 汪志鹏 <wangzhipeng628@gmail.com>
 2025-06-03 13:13:13 +08:00
Gregory Shtrasberg 9e6f61e8c3
[ROCm][Build] Clean up the ROCm build (#19040) 
Signed-off-by: Gregory Shtrasberg <Gregory.Shtrasberg@amd.com>
 2025-06-02 20:47:47 -07:00
Hyogeun Oh (오효근) 5bc1ad6cee
[Doc] Remove duplicate TOCs during MkDocs migration (#19021) 
Signed-off-by: Zerohertz <ohg3417@gmail.com>
 2025-06-02 19:49:48 -07:00
Reid 5b168b6d7a
[doc] add pytest tips (#19010) 
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
 2025-06-02 11:07:26 +00:00
Reid 432ec9926e
[doc] wrong output (#19000) 
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
 2025-06-01 11:26:14 +00:00
Reid c594cbf565
[doc] small fix - mkdocs (#18996) 
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
 2025-05-31 20:23:43 -07:00
Reid 749f5bdd38
[doc] fix the list rendering issue - security.md (#18982) 
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
 2025-05-31 10:39:21 +00:00
Lukas Geiger 0f71e24034
[Docs] Correct multiprocessing design doc (#18964) 
Signed-off-by: Lukas Geiger <lukas.geiger94@gmail.com>
 2025-05-31 01:30:15 +00:00
Isotr0py 5a8641638a
[VLM] Add PP support and fix GPTQ inference for Ovis models (#18958) 
Signed-off-by: isotr0py <2037008807@qq.com>
Signed-off-by: Isotr0py <2037008807@qq.com>
 2025-05-30 17:11:44 +00:00
Reid ec6833c5e9
[doc] show the count for fork and watch (#18950) 
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
 2025-05-30 06:45:59 -07:00
Reid 8f8900cee9
[doc] add mkdocs doc (#18930) 
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
 2025-05-30 07:58:44 +00:00
Cyrus Leung 4f4a6b844a
[Deprecation] Remove mean pooling default for `Qwen2EmbeddingModel` (#18913) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2025-05-30 06:53:37 +00:00
H 5acf828d99
[docs] fix: fix markdown syntax (#18927) 2025-05-30 05:20:48 +00:00
Hyogeun Oh (오효근) 6f2909405e
[Doc] Fix codeblocks formatting in LoRA adapters documentation (#18907) 
Signed-off-by: Zerohertz <ohg3417@gmail.com>
 2025-05-29 07:38:55 -07:00
Jee Jee Li 7fcfd954ff
[Bugfix] Fix misleading information in the documentation (#18845) 
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
 2025-05-29 02:54:14 -07:00
Reid e740d07f07
[doc] add CLI doc (#18871) 
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
 2025-05-29 09:51:36 +00:00
Michael Yao a652e71dd0
[Doc] Remove redundant spaces from compatibility_matrix.md (#18891) 
Signed-off-by: windsonsea <haifeng.yao@daocloud.io>
 2025-05-29 02:51:20 -07:00
aws-elaineyz 1661a9c28f
[Doc][Neuron] Update documentation for Neuron (#18868) 
Signed-off-by: Elaine Zhao <elaineyz@amazon.com>
 2025-05-28 19:44:01 -07:00
Mark McLoughlin 0e98964e94
[V1][Metrics] Remove metrics that were deprecated in 0.8 (#18837) 
Signed-off-by: Mark McLoughlin <markmc@redhat.com>
 2025-05-28 18:54:12 +00:00
Cyrus Leung 4318c0559d
[CI/Build] Remove imports of built-in `re` (#18750) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2025-05-27 09:19:18 +00:00
Cyrus Leung 753944fa9b
[Doc] Update reproducibility doc and example (#18741) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2025-05-27 07:03:13 +00:00
Cyrus Leung 25a817f202
[Doc] Update OOT model docs (#18742) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2025-05-27 06:30:31 +00:00
Reid 1f88dbd2bb
[Misc] improve web section group title display (#18684) 
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
 2025-05-27 04:35:16 +00:00
Cyrus Leung 82e2339b06
[Doc] Move examples and further reorganize user guide (#18666) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2025-05-26 07:38:04 -07:00
Cyrus Leung 9553fdb41e
[Doc] Improve API docs (#18713) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2025-05-26 07:33:34 -07:00
Reid 0665e29998
[Misc] add AutoGen integration (#18712) 
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
 2025-05-26 13:56:18 +00:00
Cyrus Leung fba0642704
[CI/Build][Doc] Update `gte-Qwen2-1.5B-instruct` usage (#18683) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Signed-off-by: Isotr0py <2037008807@qq.com>
Co-authored-by: Isotr0py <2037008807@qq.com>
 2025-05-25 20:27:50 -07:00
Reid 3a886bd58c
[Misc] small improve (#18680) 
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
 2025-05-25 06:05:38 -07:00
Reid 279f854519
[doc] improve readability (#18675) 
Signed-off-by: reidliu41 <reid201711@gmail.com>
Co-authored-by: reidliu41 <reid201711@gmail.com>
 2025-05-25 01:40:31 -07:00
Isotr0py 75f81750f3
[VLM] Initialize video input support for InternVL models (#18499) 
Signed-off-by: Isotr0py <2037008807@qq.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
 2025-05-25 04:51:25 +00:00
Cyrus Leung 1cb194a018
[Doc] Reorganize user guide (#18661) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2025-05-24 07:25:33 -07:00
Cyrus Leung 6d166a8d35
[Doc] Add community links (#18657) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2025-05-24 06:06:38 -07:00
Cyrus Leung ef1dd6870f
[Doc] Fix indentation problems in V0 Paged Attention docs (#18659) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2025-05-24 06:06:35 -07:00
Cyrus Leung 07458a51ce
[Doc] Update README links, mark external links (#18635) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2025-05-24 09:57:15 +00:00
Cyrus Leung 7d9216495c
[Doc] Update references to doc files (#18637) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2025-05-23 15:49:21 -07:00
Cyrus Leung 371f7e4ca2
[Doc] Fix broken links and unlinked docs, add shortcuts to home sidebar (#18627) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2025-05-23 10:22:40 -07:00
David Xia 8ddd1cf26a
[Doc] fix list formatting (#18624) 
Signed-off-by: David Xia <david@davidxia.com>
 2025-05-23 09:41:17 -07:00
Harry Mellor 3d28ad343f
Fix figures in design doc (#18612) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2025-05-23 09:09:54 -07:00