4 Commits

Author	SHA1	Message	Date
liuyhwangyh	4efff036f0	Bugfix: fix broken of download models from modelscope (#5233) ... Co-authored-by: mulin.lyh <mulin.lyh@taobao.com>	2024-06-06 09:28:10 -07:00
Woosuk Kwon	d7afab6d3a	[BugFix] Fix GC bug for `LLM` class (#2882)	2024-02-14 22:17:44 -08:00
Nikola Borisov	3209b49033	[Bugfix] fix crash if max_tokens=None (#2570)	2024-01-23 22:38:55 -08:00
Simon Mo	cb08cd0d75	[Minor] Fix duplication of ignored seq group in engine step (#1666)	2023-11-16 13:11:41 -08:00