discourse-ai/tokenizers at b25daed60b3ab96790b9a2620429dc4a5ec5a36f - discourse-ai - Gitea: Git with a cup of tea

History

Rafael dos Santos Silva b25daed60b FEATURE: Llama2 for summarization (#116 )		2023-07-27 13:55:32 -03:00
..
Apache License	Refinements to embeddings and tokenizers (#61 )	2023-05-15 15:10:42 -03:00
MIT License	Refinements to embeddings and tokenizers (#61 )	2023-05-15 15:10:42 -03:00
README.md	FEATURE: Llama2 for summarization (#116 )	2023-07-27 13:55:32 -03:00
all-mpnet-base-v2.json	FIX: Disable truncation and padding in all-mpnet-base-v2 tokenizer (#105 )	2023-07-13 21:09:46 -03:00
bert-base-uncased.json	FEATURE: Add a basic tokenizer API (#37 )	2023-04-19 11:55:59 -03:00
claude-v1-tokenization.json	Refinements to embeddings and tokenizers (#61 )	2023-05-15 15:10:42 -03:00
llama-2-70b-chat-hf.json	FEATURE: Llama2 for summarization (#116 )	2023-07-27 13:55:32 -03:00

README.md

bert-base-uncased.json

Licensed under Apache License

claude-v1-tokenization.json

Licensed under MIT License

all-mpnet-base-v2.json

Licensed under Apache License

llama-2-70b-chat-hf

Licensed under LLAMA 2 COMMUNITY LICENSE AGREEMENT