chinese-tokenizer
Version:
Simple algorithm to tokenize Chinese texts into words using CC-CEDICT.
| Filename | Content Type | Size | |
|---|---|---|---|
| 38 B | |||
| 7.27 kB | |||
| 8.91 MB | |||
| 104 B | |||
| 1.07 kB | |||
| 2.37 kB | |||
| 721 B |
Simple algorithm to tokenize Chinese texts into words using CC-CEDICT.
| Filename | Content Type | Size | |
|---|---|---|---|
| 38 B | |||
| 7.27 kB | |||
| 8.91 MB | |||
| 104 B | |||
| 1.07 kB | |||
| 2.37 kB | |||
| 721 B |