@xsai-transformers/embed

Experimental provider implementation of 🤗 Transformers.js for xsai.

This enables you possibilities to use any models supported by 🤗 Transformers.js the feel of xsai just like you are directly request OpenAI API but pure locally within the browser.

> This is also possible for runtime with WebGPU or Web Workers support, e.g. Node.js.

> [!WARNING]
>
> This haven't been released yet, it is currently only used by Project AIRI's stage and memory layer, if you found this helpful, join us to discuss on xsai #41.

Example usage

``shell
ni @xsai-transformers/embed -D # from @antfu/ni, can be installed via npm i -g @antfu/ni
pnpm i @xsai-transformers/embed -D
yarn i @xsai-transformers/embed -D
npm i @xsai-transformers/embed -D
`

`ts
import { createEmbedProvider } from '@xsai-transformers/embed'
import embedWorkerURL from '@xsai-transformers/embed/worker?worker&url'
import { embed } from '@xsai/embed'

const embedProvider = createEmbedProvider({ baseURL: xsai-transformers:///?worker-url=${embedWorkerURL} })

const handleEmbed = () => {
const res = await embed({
...embedProvider.embed('Xenova/all-MiniLM-L6-v2'),
input: 'Hello, world!',
})

console.log(res.embedding)
// {
// embedding: Array[768],
// }
}
``