UNPKG
@lenml/tokenizer-llama3
Version:
latest (3.7.2)
3.7.2
3.4.2
3.4.0
3.0.1
1.1.2
1.1.1
1.0.10
1.0.9
1.0.8
1.0.4
1.0.3
1.0.1
llama3 tokenizer for NodeJS/Browser
github.com/lenML/tokenizers
lenML/tokenizers
@lenml/tokenizer-llama3
/
models
2 files
Filename
Content Type
Size
../
tokenizer.json
application/json
9.08 MB
tokenizer_config.json
application/json
50.9 kB