UNPKG

node-llama-cpp

Version:

Run AI models locally on your machine with node.js bindings for llama.cpp. Enforce a JSON schema on the model output on the generation level

node-llama-cpp.withcat.ai

withcatai/node-llama-cpp

1 folder, 18 files
../
globals/
15.9 kB
AddonContext.cpp
37.5 kB
AddonContext.h
2.29 kB
AddonGrammar.cpp
3.17 kB
AddonGrammar.h
608 B
AddonGrammarEvaluationState.cpp
1.36 kB
AddonGrammarEvaluationState.h
469 B
AddonModel.cpp
24.7 kB
AddonModel.h
2.85 kB
AddonModelData.cpp
563 B
AddonModelData.h
280 B
AddonModelLora.cpp
3.15 kB
AddonModelLora.h
810 B
AddonSampler.cpp
25.2 kB
AddonSampler.h
2.74 kB
RingBuffer.h
2.56 kB
addon.cpp
11.1 kB
addonGlobals.cpp
727 B
addonGlobals.h
303 B