node-llama-cpp

Version:

Run AI models locally on your machine with node.js bindings for llama.cpp. Enforce a JSON schema on the model output on the generation level

7 folders, 6 files

Filename	Content Type	Size
../
addon/	–	118 kB
cmake/	–	12.4 kB
gpuInfo/	–	5.05 kB
grammars/	–	21 kB
profiles/	–	1.56 kB
toolchains/	–	2.95 kB
xpack/	–	179 B
.clang-format	application/octet-stream	1.23 kB
CMakeLists.txt	text/plain	3.99 kB
binariesGithubRelease.json	application/json	27 B
gitRelease.bundle	application/octet-stream	19.6 MB
llama.cpp.info.json	application/json	71 B
package.json	application/json	47 B