UNPKG

@lenml/tokenizer-llama3

Version:

llama3 tokenizer for NodeJS/Browser

github.com/lenML/tokenizers

lenML/tokenizers

3 folders, 3 files
dist/
67 MB
models/
9.14 MB
src/
1.1 kB
LICENSE
1.08 kB
package.json
1.86 kB
readme.md
610 B