@browser-ai/web-llm

v2.1.1TypeScript

WebLLM provider for Vercel AI SDK v5+ (High-performance in-browser LLM inference)

ai ai-sdk vercel webllm web-llm browser-ai mlc-ai webgpu language-model llm

0/weekUpdated 2 days agoApache LicenseUnpacked: 392.9 KB

Published by Jakob Hoeg Mørk

npm install @browser-ai/web-llm

Repository Homepage npm

WebLLM provider for Vercel AI SDK

!Hero

![NPM Version](https://www.npmjs.com/package/@browser-ai/web-llm)
![NPM Downloads](https://www.npmjs.com/package/@browser-ai/web-llm)

WebLLM model provider for Vercel AI SDK. This library enables you to easily use the AI SDK with popular open-source models running directly in your web browser.

Installation

``bash npm i @browser-ai/web-llm`

The @browser-ai/web-llm` package is the AI SDK provider for open-source built-in browser AI models leveraging the WebLLM inference engine.

Documentation

For a complete documentation including examples, refer to this site.

Author

Credits

The WebLLM & Vercel teams

@browser-ai/web-llm - npm explorer