UNPKG
@lenml/tokenizer-llama3
Version:
latest (3.7.2)
3.7.2
3.4.2
3.4.0
3.0.1
1.1.2
1.1.1
1.0.10
1.0.9
1.0.8
1.0.4
1.0.3
1.0.1
llama3 tokenizer for NodeJS/Browser
github.com/lenML/tokenizers
lenML/tokenizers
@lenml/tokenizer-llama3
/
src
2 files
Filename
Content Type
Size
../
data.ts
text/typescript
421 B
main.ts
text/typescript
684 B