UNPKG

node-llama-cpp

Version:

Run AI models locally on your machine with node.js bindings for llama.cpp. Enforce a JSON schema on the model output on the generation level

node-llama-cpp.withcat.ai

withcatai/node-llama-cpp

7 lines (6 loc) • 262 B
1
2
3
4
5
6
7
type BinariesGithubReleaseFile = { release: "latest" | string; }; export declare function getBinariesGithubRelease(): Promise<string>; export declare function setBinariesGithubRelease(release: BinariesGithubReleaseFile["release"]): Promise<void>; export {};