19 Commits

Author	SHA1	Message	Date
Cyrus Leung	8a924d2248	[Doc] Guide for adding multi-modal plugins (#6205)	2024-07-10 14:55:34 +08:00
Cyrus Leung	9389380015	[Doc] Move guide for multimodal model and other improvements (#6168)	2024-07-06 17:18:59 +08:00
Cyrus Leung	ae96ef8fbd	[VLM] Calculate maximum number of multi-modal tokens by model (#6121)	2024-07-04 16:37:23 -07:00
xwjiang2010	d9e98f42e4	[vlm] Remove vision language config. (#6089) ... Signed-off-by: Xiaowei Jiang <xwjiang2010@gmail.com> Co-authored-by: Roger Wang <ywang@roblox.com>	2024-07-03 22:14:16 +00:00
Cyrus Leung	9831aec49f	[Core] Dynamic image size support for VLMs (#5276) ... Signed-off-by: Xiaowei Jiang <xwjiang2010@gmail.com> Co-authored-by: Xiaowei Jiang <xwjiang2010@gmail.com> Co-authored-by: ywang96 <ywang@roblox.com> Co-authored-by: xwjiang2010 <87673679+xwjiang2010@users.noreply.github.com> Co-authored-by: Roger Wang <136131678+ywang96@users.noreply.github.com>	2024-07-02 20:34:00 -07:00
xwjiang2010	98d6682cd1	[VLM] Remove `image_input_type` from VLM config (#5852) ... Signed-off-by: Xiaowei Jiang <xwjiang2010@gmail.com> Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com> Co-authored-by: Roger Wang <ywang@roblox.com>	2024-07-02 07:57:09 +00:00
Cyrus Leung	5cbe8d155c	[Core] Registry for processing model inputs (#5214) ... Co-authored-by: ywang96 <ywang@roblox.com>	2024-06-28 12:09:56 +00:00
Roger Wang	1b2eaac316	[Bugfix][Doc] FIx Duplicate Explicit Target Name Errors (#5703)	2024-06-19 23:10:47 -07:00
Rafael Vasquez	e83db9e7e3	[Doc] Update docker references (#5614) ... Signed-off-by: Rafael Vasquez <rafvasq21@gmail.com>	2024-06-19 15:01:45 -07:00
Cyrus Leung	7a64d24aad	[Core] Support image processor (#4197)	2024-06-02 22:56:41 -07:00
Cyrus Leung	5ae5ed1e60	[Core] Consolidate prompt arguments to LLM engines (#4328) ... Co-authored-by: Roger Wang <ywang@roblox.com>	2024-05-28 13:29:31 -07:00
Cyrus Leung	4bfa7e7f75	[Doc] Add API reference for offline inference (#4710)	2024-05-13 17:47:42 -07:00
Prashant Gupta	b31a1fb63c	[Doc] add visualization for multi-stage dockerfile (#4456) ... Signed-off-by: Prashant Gupta <prashantgupta@us.ibm.com> Co-authored-by: Roger Wang <ywang@roblox.com>	2024-04-30 17:41:59 +00:00
Harry Mellor	34128a697e	Fix `autodoc` directives (#4272) ... Co-authored-by: Harry Mellor <hmellor@oxts.com>	2024-04-23 01:53:01 +00:00
Simon Mo	ef65dcfa6f	[Doc] Add docs about OpenAI compatible server (#3288)	2024-03-18 22:05:34 -07:00
laneeee	8fa7357f2d	fix document error for value and v_vec illustration (#3421)	2024-03-15 16:06:09 -07:00
Zhuohan Li	4c922709b6	Add distributed model executor abstraction (#3191)	2024-03-11 11:03:45 -07:00
Jialun Lyu	27a7b070db	Add document for vllm paged attention kernel. (#2978)	2024-03-04 09:23:34 -08:00
Jiaxiang	6549aef245	[DOC] Add additional comments for LLMEngine and AsyncLLMEngine (#1011)	2024-01-11 19:26:49 -08:00