Transformers.js wrapper makes it easy to use with xsai
npm install @xsai-transformers/chat@xsai-transformers/chatExperimental provider implementation of 🤗 Transformers.js for xsai.
This enables you possibilities to use any models supported by 🤗 Transformers.js the feel of xsai just like you are directly request OpenAI API but pure locally within the browser.
> This is also possible for runtime with WebGPU or Web Workers support, e.g. Node.js.
> [!WARNING]
>
> This haven't been released yet, it is currently only used by Project AIRI's stage and memory layer, if you found this helpful, join us to discuss on xsai #41.
``shellnpm i -g @antfu/ni
ni @xsai-transformers/chat -D # from @antfu/ni, can be installed via `
pnpm i @xsai-transformers/chat -D
yarn i @xsai-transformers/chat -D
npm i @xsai-transformers/chat -D
`ts
import { createChatProvider } from '@xsai-transformers/chat'
import chatWorkerURL from '@xsai-transformers/chat/worker?worker&url'
import { generateText } from '@xsai/chat'
const chatProvider = createChatProvider({ baseURL: xsai-transformers:///?worker-url=${chatWorkerURL} })
const handleChat = () => {
const res = await generateText({
...chatProvider.chat('onnx-community/gemma-3-270m-it-ONNX', { dtype: 'q4' }),
messages: [{ content: 'Hi! How are you?', role: 'user' }],
})
console.log(res)
}
``