UNPKG

@lenml/tokenizer-gemini

Version:

gemini tokenizer for NodeJS/Browser

github.com/lenML/tokenizers

lenML/tokenizers

2 files

	Filename	Content Type	Size
	../
	tokenizer.json	application/json	17.5 MB
	tokenizer_config.json	application/json	40.6 kB