node-llama-cpp

Version:

Run AI models locally on your machine with node.js bindings for llama.cpp. Enforce a JSON schema on the model output on the generation level

12 files

Filename	Content Type	Size
../
getRamUsageFromUnifiedVram.d.ts	text/typescript	157 B
getRamUsageFromUnifiedVram.js	text/javascript	419 B
getRamUsageFromUnifiedVram.js.map	application/json	571 B
resolveContextContextSizeOption.d.ts	text/typescript	1.2 kB
resolveContextContextSizeOption.js	text/javascript	7.38 kB
resolveContextContextSizeOption.js.map	application/json	5.54 kB
resolveModelGpuLayersOption.d.ts	text/typescript	856 B
resolveModelGpuLayersOption.js	text/javascript	10.1 kB
resolveModelGpuLayersOption.js.map	application/json	8.06 kB
scoreLevels.d.ts	text/typescript	130 B
scoreLevels.js	text/javascript	502 B
scoreLevels.js.map	application/json	761 B