UNPKG

cjk-tokenizer

Version:

A CJK text tokenizer

github.com/leungwensen/cjk-tokenizer

leungwensen/cjk-tokenizer

2 folders, 5 files

	Filename	Content Type	Size
	../
	stop-word/	–	1.57 kB
	tokenizer/	–	6.41 kB
	add-word-into-term.js	text/javascript	698 B
	constant.js	text/javascript	562 B
	get-indices.js	text/javascript	423 B
	get-sub-strings.js	text/javascript	614 B
	index.js	text/javascript	1 kB