gpt-tokenizer
Version:
A pure JavaScript implementation of a BPE tokenizer (Encoder/Decoder) for GPT-2 / GPT-3 / GPT-4 and other OpenAI models
| Filename | Content Type | Size | |
|---|---|---|---|
| ../ | |||
| 994 kB | |||
| 1.79 MB | |||
| 2.06 MB | |||
| 3.47 MB | |||
| 512 kB | |||
| 941 kB | |||
| 512 kB | |||
| 941 kB | |||
| 511 kB | |||
| 940 kB | |||
A pure JavaScript implementation of a BPE tokenizer (Encoder/Decoder) for GPT-2 / GPT-3 / GPT-4 and other OpenAI models
| Filename | Content Type | Size | |
|---|---|---|---|
| ../ | |||
| 994 kB | |||
| 1.79 MB | |||
| 2.06 MB | |||
| 3.47 MB | |||
| 512 kB | |||
| 941 kB | |||
| 512 kB | |||
| 941 kB | |||
| 511 kB | |||
| 940 kB | |||