node-llama-cpp

Version:

Run AI models locally on your machine with node.js bindings for llama.cpp. Enforce a JSON schema on the model output on the generation level

7 folders, 6 files

Filename	Content Type	Size
../
addon/	–	129 kB
cmake/	–	13 kB
gpuInfo/	–	8.61 kB
grammars/	–	22.1 kB
profiles/	–	1.56 kB
toolchains/	–	2.95 kB
xpack/	–	179 B
.clang-format	application/octet-stream	1.23 kB
CMakeLists.txt	text/plain	5.02 kB
binariesGithubRelease.json	application/json	27 B
gitRelease.bundle	application/octet-stream	27 MB
llama.cpp.info.json	application/json	71 B
package.json	application/json	47 B