node-llama-cpp

Version:

Run AI models locally on your machine with node.js bindings for llama.cpp. Enforce a JSON schema on the model output on the generation level

12 files

Filename	Content Type	Size
../
getRamUsageFromUnifiedVram.d.ts	text/typescript	157 B
getRamUsageFromUnifiedVram.js	text/javascript	419 B
getRamUsageFromUnifiedVram.js.map	application/json	571 B
resolveContextContextSizeOption.d.ts	text/typescript	1.16 kB
resolveContextContextSizeOption.js	text/javascript	7.28 kB
resolveContextContextSizeOption.js.map	application/json	5.5 kB
resolveModelGpuLayersOption.d.ts	text/typescript	787 B
resolveModelGpuLayersOption.js	text/javascript	8.1 kB
resolveModelGpuLayersOption.js.map	application/json	6.11 kB
scoreLevels.d.ts	text/typescript	130 B
scoreLevels.js	text/javascript	502 B
scoreLevels.js.map	application/json	761 B