5 Commits

Author	SHA1	Message	Date
Simon Mo	ef65dcfa6f	[Doc] Add docs about OpenAI compatible server (#3288)	2024-03-18 22:05:34 -07:00
laneeee	8fa7357f2d	fix document error for value and v_vec illustration (#3421)	2024-03-15 16:06:09 -07:00
Zhuohan Li	4c922709b6	Add distributed model executor abstraction (#3191)	2024-03-11 11:03:45 -07:00
Jialun Lyu	27a7b070db	Add document for vllm paged attention kernel. (#2978)	2024-03-04 09:23:34 -08:00
Jiaxiang	6549aef245	[DOC] Add additional comments for LLMEngine and AsyncLLMEngine (#1011)	2024-01-11 19:26:49 -08:00