UNPKG

@lenml/tokenizer-yi

Version:

yi tokenizer for NodeJS/Browser

github.com/lenML/tokenizers

lenML/tokenizers

2 files

	Filename	Content Type	Size
	../
	tokenizer.json	application/json	3.56 MB
	tokenizer_config.json	application/json	320 B