@lenml/tokenizers
Version:
a lightweight no-dependency fork of transformers.js (only tokenizers)
| Filename | Content Type | Size | |
|---|---|---|---|
| ../ | |||
| 104 B | |||
| 4.72 kB | |||
| 12.8 kB | |||
| 1.17 kB | |||
| 3.99 kB | |||
| 32.5 kB | |||
| 510 B | |||
a lightweight no-dependency fork of transformers.js (only tokenizers)
| Filename | Content Type | Size | |
|---|---|---|---|
| ../ | |||
| 104 B | |||
| 4.72 kB | |||
| 12.8 kB | |||
| 1.17 kB | |||
| 3.99 kB | |||
| 32.5 kB | |||
| 510 B | |||