vLLM
/
vllm
mirror of https://github.com/vllm-project/vllm.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
7,421 Commits 73 Branches 67 Tags 518 MiB
Commit Graph

49 Commits

Author SHA1 Message Date
Lionel Villard c05596f1a3
[Perf] Validate @config in pre-commit instead of dynamically (#20200) 
Signed-off-by: Lionel Villard <villard@us.ibm.com>
 2025-07-01 05:10:28 -04:00
Yang Wang 8b64c895c0
[CI] Sync test dependency with test.in for torch nightly (#19632) 
Signed-off-by: Yang Wang <elainewy@meta.com>
Signed-off-by: Yida Wu <yidawu@alumni.cmu.edu>
Signed-off-by: Nick Hill <nhill@redhat.com>
Co-authored-by: Concurrensee <yida.wu@amd.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: Nick Hill <nhill@redhat.com>
 2025-06-26 20:55:25 -07:00
Michael Goin bf5181583f
[Doc] Guide for Incremental Compilation Workflow (#19109) 2025-06-25 22:06:46 +09:00
Aaron Pham c4cf260677
[Perf][CLI] Improve overall startup time (#19941) 2025-06-22 23:11:22 +00:00
afeldman-nm 16c16301c8
Disable "Forbid direct 'import triton'" check for `vllm/triton_utils/importing.py` in an extensible way (#19783) 
Signed-off-by: Andrew Feldman <afeldman@redhat.com>
 2025-06-18 15:08:00 -07:00
Russell Bryant 4f6c42fa0a
[Security] Prevent new imports of (cloud)pickle (#18018) 
Signed-off-by: Russell Bryant <rbryant@redhat.com>
Co-authored-by: Aaron Pham <Aaronpham0103@gmail.com>
 2025-06-12 10:30:17 +00:00
Ning Xie 2f1c19b245
[CI] change spell checker from codespell to typos (#18711) 
Signed-off-by: Andy Xie <andy.xning@gmail.com>
 2025-06-11 19:57:10 -07:00
youkaichao 64a9af5afa
Simplify ep kernels installation (#19412) 
Signed-off-by: youkaichao <youkaichao@gmail.com>
 2025-06-10 20:06:08 +08:00
Simon Mo 02f0c7b220
[Misc] Add SPDX-FileCopyrightText (#19100) 
Signed-off-by: simon-mo <simon.mo@hey.com>
 2025-06-03 11:20:17 -07:00
Daniele 43ff405b90
[CI/Build] remove regex from build dependencies (#18945) 
Signed-off-by: Daniele Trifirò <dtrifiro@redhat.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
 2025-05-30 04:02:50 -07:00
Cyrus Leung 4318c0559d
[CI/Build] Remove imports of built-in `re` (#18750) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2025-05-27 09:19:18 +00:00
Aaron Pham 2807271c86
[CI] enforce import regex instead of re (#18665) 
Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
 2025-05-24 08:04:14 -07:00
Mengqing Cao e77dc4bad8
[MISC][pre-commit] Add pre-commit check for triton import (#17716) 
Signed-off-by: Mengqing Cao <cmq0113@163.com>
 2025-05-24 20:09:15 +08:00
Cyrus Leung 7d9216495c
[Doc] Update references to doc files (#18637) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2025-05-23 15:49:21 -07:00
lkchen 7b9d832c80
[Tool] Add NIXL installation script (#18172) 
Signed-off-by: Linkun <github@lkchen.net>
 2025-05-22 14:33:16 -07:00
youkaichao d45fe333fb
[misc] add instructions on how to install nvshmem/pplx/deepep (#17964) 
Signed-off-by: youkaichao <youkaichao@gmail.com>
 2025-05-11 18:02:39 -07:00
Harry Mellor 05e1f96419
Fix `dockerfilegraph` pre-commit hook (#17698) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2025-05-06 08:56:48 +00:00
wineandchord 8661c0241d
[CI] Add auto update workflow for Dockerfile graph (#11879) 
Signed-off-by: wineandchord <guoqizhou19@gmail.com>
 2025-04-10 13:43:05 +00:00
Kevin H. Luu 4dc52e1c53
[CI] Reorganize .buildkite directory (#16001) 
Signed-off-by: kevin <kevin@anyscale.com>
 2025-04-04 12:16:20 -07:00
Harry Mellor cf069aa8aa
Update deprecated Python 3.8 typing (#13971) 2025-03-02 17:34:51 -08:00
Russell Bryant 33e0602e59
[Misc] Fix improper placement of SPDX header in scripts (#12694) 
Signed-off-by: Russell Bryant <rbryant@redhat.com>
 2025-02-03 11:16:59 -08:00
Russell Bryant e489ad7a21
[Misc] Add SPDX-License-Identifier headers to python source files (#12628) 
- **Add SPDX license headers to python source files**
- **Check for SPDX headers using pre-commit**

commit 9d7ef44c3cfb72ca4c32e1c677d99259d10d4745
Author: Russell Bryant <rbryant@redhat.com>
Date:   Fri Jan 31 14:18:24 2025 -0500

    Add SPDX license headers to python source files
    
This commit adds SPDX license headers to python source files as
recommended to
the project by the Linux Foundation. These headers provide a concise way
that is
both human and machine readable for communicating license information
for each
source file. It helps avoid any ambiguity about the license of the code
and can
    also be easily used by tools to help manage license compliance.
    
The Linux Foundation runs license scans against the codebase to help
ensure
    we are in compliance with the licenses of the code we use, including
dependencies. Having these headers in place helps that tool do its job.
    
    More information can be found on the SPDX site:
    
    - https://spdx.dev/learn/handling-license-info/
    
    Signed-off-by: Russell Bryant <rbryant@redhat.com>

commit 5a1cf1cb3b80759131c73f6a9dddebccac039dea
Author: Russell Bryant <rbryant@redhat.com>
Date:   Fri Jan 31 14:36:32 2025 -0500

    Check for SPDX headers using pre-commit
    
    Signed-off-by: Russell Bryant <rbryant@redhat.com>

---------

Signed-off-by: Russell Bryant <rbryant@redhat.com>
 2025-02-02 11:58:18 -08:00
Harry Mellor 823ab79633
Update `pre-commit` hooks (#12475) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2025-01-27 17:23:08 -07:00
Chen Zhang 96663699b2
[CI] Pass local python version explicitly to pre-commit mypy.sh (#12224) 
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
 2025-01-20 23:49:18 +08:00
youkaichao 5c89a29c22
[misc] add placeholder format.sh (#12206) 
Signed-off-by: youkaichao <youkaichao@gmail.com>
 2025-01-20 16:04:49 +08:00
Harry Mellor 3ea7b94523
Move linting to `pre-commit` (#11975) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2025-01-20 14:58:01 +08:00
Rafael Vasquez 43f3d9e699
[CI/Build] Add markdown linter (#11857) 
Signed-off-by: Rafael Vasquez <rafvasq21@gmail.com>
 2025-01-12 00:17:13 -08:00
Harry Mellor 482cdc494e
[Doc] Rename offline inference examples (#11927) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2025-01-10 23:50:29 +08:00
Harry Mellor aba8d6ee00
[Doc] Move examples into categories (#11840) 
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
 2025-01-08 13:09:53 +00:00
Tobias Pitters b6087a6bee
[mypy] Pass type checking in vllm/inputs (#11680) 
Signed-off-by: Tobias Pitters <tobias.pitters@gmail.com>
 2025-01-02 16:18:15 +00:00
Varun Sundar Rabindranath efbce85f4d
[misc] Layerwise profile updates (#10242) 
Signed-off-by: Varun Sundar Rabindranath <varun@neuralmagic.com>
Co-authored-by: Varun Sundar Rabindranath <varun@neuralmagic.com>
 2024-12-16 18:14:57 +00:00
Mark McLoughlin 6d917d0eeb
Enable mypy checking on V1 code (#11105) 
Signed-off-by: Mark McLoughlin <markmc@redhat.com>
 2024-12-14 09:54:04 -08:00
Rafael Vasquez 709c9f1f25
[CI/Build] Add sphinx/rst linter for docs (#10366) 2024-11-19 21:35:31 -08:00
Russell Bryant 5390d6664f
[Doc] Add the start of an arch overview page (#10368) 2024-11-19 09:52:11 +00:00
Cyrus Leung 675d603400
[CI/Build] Make shellcheck happy (#10285) 
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
 2024-11-14 09:47:53 +00:00
Luka Govedič 87713c6053
[CI/Build] Ignore .gitignored files for shellcheck (#10162) 
Signed-off-by: luka <luka@neuralmagic.com>
 2024-11-08 19:53:36 +00:00
Russell Bryant 3be5b26a76
[CI/Build] Add shell script linting using shellcheck (#7925) 
Signed-off-by: Russell Bryant <rbryant@redhat.com>
 2024-11-07 18:17:29 +00:00
Russell Bryant e036e527a0
[CI/Build] Improve mypy + python version matrix (#10041) 
Signed-off-by: Russell Bryant <rbryant@redhat.com>
 2024-11-07 07:54:16 +00:00
Hanzhi Zhou 6192e9b8fe
[Core][Distributed] Refactor ipc buffer init in CustomAllreduce (#10030) 
Signed-off-by: Hanzhi Zhou <hanzhi713@gmail.com>
 2024-11-06 23:50:47 -08:00
Aaron Pham 21063c11c7
[CI/Build] drop support for Python 3.8 EOL (#8464) 
Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
 2024-11-06 07:11:55 +00:00
Russell Bryant 67a7e5ef38
[CI/Build] Add error matching config for mypy (#9512) 2024-10-18 12:17:53 -07:00
bnellnm eca2c5f7c0
[Bugfix] Fix support for dimension like integers and ScalarType (#9299) 2024-10-17 19:08:34 +00:00
Daniele a2c71c5405
[CI/Build] remove .github from .dockerignore, add dirty repo check (#9375) 2024-10-17 10:25:06 -07:00
Lucas Wilkinson 9d30a056e7
[misc] CUDA Time Layerwise Profiler (#8337) 
Co-authored-by: Varun Sundar Rabindranath <varun@neuralmagic.com>
Co-authored-by: Michael Goin <michael@neuralmagic.com>
 2024-10-17 10:36:09 -04:00
Russell Bryant 776dbd74f1
[CI/Build] mypy: Resolve some errors from checking vllm/engine (#9267) 
Signed-off-by: Russell Bryant <rbryant@redhat.com>
 2024-10-16 22:55:59 +00:00
Russell Bryant cdca8994bd
[CI/Build] mypy: check vllm/entrypoints (#9194) 
Signed-off-by: Russell Bryant <rbryant@redhat.com>
 2024-10-09 17:15:28 +00:00
Russell Bryant 2a131965a8
mypy: check additional directories (#9162) 
Signed-off-by: Russell Bryant <rbryant@redhat.com>
 2024-10-08 22:08:22 +00:00
Russell Bryant e0dbdb013d
[CI/Build] Add linting for github actions workflows (#7876) 
Signed-off-by: Russell Bryant <rbryant@redhat.com>
 2024-10-07 21:18:10 +00:00
Lucas Wilkinson aeb37c2a72
[CI/Build] Per file CUDA Archs (improve wheel size and dev build times) (#8845) 2024-10-03 22:55:25 -04:00