| [NPM Package](https://www.npmjs.com/package/@mlc-ai/web-tokenizers) | [WebLLM](https://github.com/mlc-ai/web-llm) |
npm install @agnai/web-tokenizers| NPM Package | WebLLM |
WebTokenizers is a javascript binding library that can be universally deployed.
It wraps and binds the HuggingFace tokenizers library
and sentencepiece and provides a minimum common interface
in havascript.
``bash`
source /path/to/emsdk_env.sh
npm install
npm run build
To try out the test webpage
`bash``
cd tests
npm start