vLLM
/
vllm
mirror of https://github.com/vllm-project/vllm.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
7,204 Commits 73 Branches 67 Tags 518 MiB
Commit Graph

7204 Commits

Author SHA1 Message Date
Woosuk Kwon 343cea3dbc Add seq_ids to input metadata 2023-02-23 09:25:01 +00:00
Woosuk Kwon 4f6f4967f6 Add get_block_table 2023-02-23 07:55:14 +00:00
Woosuk Kwon 331fa0b042 Implement scheduler.step & Add a threshold for batch size 2023-02-23 07:54:20 +00:00
Woosuk Kwon 501c4bd0cd decoding.py -> sampling_params.py 2023-02-23 07:39:20 +00:00
Woosuk Kwon 86c682cd32 DecodingParams -> SamplingParams 2023-02-23 07:38:43 +00:00
Woosuk Kwon af16c05074 Add get_len 2023-02-23 05:58:04 +00:00
Woosuk Kwon d094512296 Move max_context_len 2023-02-23 04:57:46 +00:00
Woosuk Kwon 4b1ac23f53 Fix slot mapping 2023-02-23 00:10:07 +00:00
Woosuk Kwon 8290fce47d Add Worker class 2023-02-22 19:01:38 +00:00
Woosuk Kwon 7b6844e590 Add input metadata 2023-02-22 19:01:20 +00:00
Woosuk Kwon 608f74ffe5 Minor 2023-02-22 18:08:25 +00:00
Woosuk Kwon 709a69176e Move worker/models -> models 2023-02-22 18:03:48 +00:00
Woosuk Kwon af68ec1c5c Add tests for kernels 2023-02-18 19:23:07 +00:00
Woosuk Kwon c413c41cda Add reshape_and_cache op 2023-02-18 19:22:57 +00:00
Woosuk Kwon ffad4e1e03 cache_kernel -> cache_kernels 2023-02-16 20:05:45 +00:00
Woosuk Kwon 6d2f74efb3 Remove redundant fn 2023-02-16 09:24:42 +00:00
Woosuk Kwon 3b41f16596 Add gitignore 2023-02-16 07:47:21 +00:00
Woosuk Kwon 6f058c7ba8 Implement cache ops 2023-02-16 07:47:03 +00:00
Woosuk Kwon a1c67e6db8 Minor 2023-02-16 01:42:53 +00:00
Woosuk Kwon 9e68a6827e Fix return type error 2023-02-16 01:33:03 +00:00
Woosuk Kwon 8edcabc737 Add warning 2023-02-16 01:28:17 +00:00
Woosuk Kwon 2f4887de77 Fix KVCache shape 2023-02-16 01:24:45 +00:00
Woosuk Kwon 3363c27d19 Add __repr__ 2023-02-14 09:34:07 +00:00
Woosuk Kwon 2729087efe Fix a ref count bug in swapping 2023-02-14 09:20:12 +00:00
Woosuk Kwon c128c2ed03 Fix double free 2023-02-14 09:14:05 +00:00
Woosuk Kwon c80ed212a1 Minor 2023-02-14 09:06:27 +00:00
Woosuk Kwon 263e91b386 Minor 2023-02-14 09:05:39 +00:00
Woosuk Kwon be1e2163c9 Fix memory leak in swapping 2023-02-14 08:46:33 +00:00
Woosuk Kwon 7e5f604e68 Fix bugs in scheduler 2023-02-14 02:25:32 +00:00
Woosuk Kwon 1f739f9b03 Fix a bug in swap_in and swap_out 2023-02-14 02:12:58 +00:00
Woosuk Kwon b1644f764f Fix can_swap_in 2023-02-14 01:57:40 +00:00
Woosuk Kwon c574f19506 Fix typo 2023-02-14 01:19:27 +00:00
Woosuk Kwon e40fa136aa Fix typo 2023-02-14 01:19:05 +00:00
Woosuk Kwon ee9442518d Fix get_model 2023-02-13 22:51:03 +00:00
Woosuk Kwon 531e1c74e8 Fix typo 2023-02-13 18:51:33 +00:00
Woosuk Kwon d3d317665b Fix scheduler 2023-02-13 09:37:00 +00:00
Woosuk Kwon fffa2e1f4b Add model_utils 2023-02-13 09:36:12 +00:00
Woosuk Kwon bb59a3e730 Fix cache engine 2023-02-13 09:35:48 +00:00
Woosuk Kwon 5a309bb588 Add scheduler 2023-02-13 02:39:53 +00:00
Woosuk Kwon 0961f5a49a Add find method to sequence group 2023-02-13 02:39:12 +00:00
Woosuk Kwon eb52db1bea Fix can_swap_in 2023-02-13 02:38:50 +00:00
Woosuk Kwon a2a9869cb7 SERVING -> RUNNING 2023-02-12 08:25:05 +00:00
Woosuk Kwon 46958cf941 BlockAllocator -> BlockManager 2023-02-12 08:15:18 +00:00
Woosuk Kwon 3be29a1104 Add blank setup file 2023-02-09 11:37:06 +00:00
Woosuk Kwon 38ed06a846 Minor 2023-02-09 11:30:55 +00:00
Woosuk Kwon 0a11a2e5ca Add gitignore 2023-02-09 11:28:12 +00:00
Woosuk Kwon e7bee2aa81 Add cache engine 2023-02-09 11:28:02 +00:00
Woosuk Kwon aa78aeaa0f Add block manager 2023-02-09 11:27:33 +00:00
Woosuk Kwon 3c2b47fcae Add decoding params 2023-02-09 11:27:06 +00:00
Woosuk Kwon 5e644b912e Add utils 2023-02-09 11:26:50 +00:00