gpt-tokenizer/src/package.json

A pure JavaScript implementation of a BPE tokenizer (Encoder/Decoder) for GPT-2 / GPT-3 / GPT-4 and other OpenAI models

{
  "name": "gpt-tokenizer",
  "type": "module",
  "dependencies": {}
}