UNPKG

cjk-tokenizer

Version:

A CJK text tokenizer

github.com/leungwensen/cjk-tokenizer

leungwensen/cjk-tokenizer

6 files

	Filename	Content Type	Size
	../
	arrays.dic	application/octet-stream	4.21 MB
	jieba-dict.big.txt	text/plain	8.58 MB
	jieba-dict.small.txt	text/plain	1.55 MB
	jieba-dict.txt	text/plain	5.07 MB
	jieba-idf.big.txt	text/plain	4.09 MB
	segmenting.txt	text/plain	1.7 kB