UNPKG

@scrypted/llm

Version:

The Scrypted LLM plugin allows connecting to various LLM providers, or running your own locally.

10 lines (6 loc) • 312 B
1
2
3
4
5
6
7
8
9
10
# Scrypted LLM Plugin The Scrypted LLM plugin allows connecting to various LLM providers, or running your own locally. The LLM plugin requirements: * Docker/Proxmox: Must be using either the `intel` or `nvidia` docker tags. * Mac: Works out of the box * Windows: Intel requires installing the OneAPI toolkit.