UNPKG

@orama/tokenizers

Version:

Additional tokenizers for Orama

15 lines (14 loc) 318 B
{ "name": "tokenizer-mandarin", "version": "0.1.0", "files": [ "tokenizer_mandarin_bg.wasm", "tokenizer_mandarin.js", "tokenizer_mandarin.d.ts" ], "module": "tokenizer_mandarin.js", "types": "tokenizer_mandarin.d.ts", "sideEffects": [ "./snippets/*" ] }