UNPKG

@lenml/tokenizers

Version:

a lightweight no-dependency fork of transformers.js (only tokenizers)

github.com/lenML/tokenizers

lenML/tokenizers

7 files

	Filename	Content Type	Size
	../
	main.d.ts	text/typescript	63.6 kB
	main.global.js	text/javascript	102 kB
	main.global.js.map	application/json	506 kB
	main.js	text/javascript	102 kB
	main.js.map	application/json	506 kB
	main.mjs	text/javascript	102 kB
	main.mjs.map	application/json	506 kB