UNPKG
cjk-tokenizer
Version:
latest (0.1.0)
0.1.0
0.0.1
A CJK text tokenizer
github.com/leungwensen/cjk-tokenizer
leungwensen/cjk-tokenizer
cjk-tokenizer
/
spec
/
fixtures
3 folders,
0 files
Filename
Content Type
Size
../
chinese/
–
23.5 MB
english/
–
19.4 kB
japanese/
–
3.23 kB