The Scrypted LLM plugin allows connecting to various LLM providers, or running your own locally.
npm install @blueharford/scrypted-llmThe Scrypted LLM plugin allows connecting to various LLM providers, or running your own locally.
The LLM plugin requirements:
* Docker/Proxmox: Must be using either the intel or nvidia docker tags.
* Mac: Works out of the box
* Windows: Intel requires installing the OneAPI toolkit.