UNPKG

@lenml/tokenizer-gpt2

Version:

gpt2 tokenizer for NodeJS/Browser

github.com/lenML/tokenizers

lenML/tokenizers

2 files

	Filename	Content Type	Size
	../
	tokenizer.json	application/json	2.11 MB
	tokenizer_config.json	application/json	234 B