UNPKG

node-llama-cpp

Version:

Run AI models locally on your machine with node.js bindings for llama.cpp. Enforce a JSON schema on the model output on the generation level

5 lines (4 loc) 232 B
import retry from "async-retry"; export declare const ggufDefaultFetchRetryOptions: retry.Options; export declare const defaultExtraAllocationSize: number; export declare const noDirectSubNestingGGufMetadataKeys: readonly string[];