Showing 1-20 of 290 packages
OpenVINO™ Tokenizers adds text processing operations to openvino-node package
Additional tokenizers for Orama
Multi-arch builds of HuggingFace tokenizers
a lightweight no-dependency fork of transformers.js (only tokenizers)
| [NPM Package](https://www.npmjs.com/package/@mlc-ai/web-tokenizers) | [WebLLM](https://github.com/mlc-ai/web-llm) |
Scrypted OpenVINO Object Detection
This [remark][remark] plugin can disable any or all remark `blockTokenizers` and `inlineTokenizers`. It can not only disable the ones provided by remark core, but also any other tokenizer that has been added to the remark parser whether through plugins or
NodeJS implementation of @Qdrant/fastembed
Multi-arch builds of HuggingFace tokenizers
Scrypted Video Analysis Plugin. Installed alongside a detection service like OpenCV or TensorFlow.
Multi-arch builds of HuggingFace tokenizers
JavaScript port of tiktoken
OpenVINO™ utils for using from Node.js environment
A promise based streaming tokenizer