UNPKG

@lenml/tokenizer-gpt2

Version:

gpt2 tokenizer for NodeJS/Browser

github.com/lenML/tokenizers

lenML/tokenizers

7 files

	Filename	Content Type	Size
	../
	main.d.ts	text/typescript	497 B
	main.global.js	text/javascript	1.64 MB
	main.global.js.map	application/json	3.7 MB
	main.js	text/javascript	1.54 MB
	main.js.map	application/json	3.2 MB
	main.mjs	text/javascript	1.54 MB
	main.mjs.map	application/json	3.2 MB