UNPKG

@huggingface/hub

Version:

Utilities to interact with the Hugging Face hub

github.com/huggingface/huggingface.js

huggingface/huggingface.js

8 lines (4 loc) • 452 B
1
2
3
4
5
6
7
8
# Xet-Chunk WASM utilities to chunk & hash data. An assembly script implementation is available in `@huggingface/xetchunk-wasm`, but for performance reasons we're using WASM directly compiled from the rust source, see https://github.com/huggingface/xet-core/tree/main/hf_xet_wasm which on my local machine processes data at 480MB/s. The `chunker_wasm_bg.js`and `chunker_wasm_bg.wasm.base64.ts` are generated with `pnpm --filter hub build:xet-wasm`.