node-llama-cpp

Version:

Run AI models locally on your machine with node.js bindings for llama.cpp. Enforce a JSON schema on the model output on the generation level

6 files

Filename	Content Type	Size
../
DraftSequenceTokenPredictor.d.ts	text/typescript	2.49 kB
DraftSequenceTokenPredictor.js	text/javascript	12.7 kB
DraftSequenceTokenPredictor.js.map	application/json	10.3 kB
InputLookupTokenPredictor.d.ts	text/typescript	1.98 kB
InputLookupTokenPredictor.js	text/javascript	6.5 kB
InputLookupTokenPredictor.js.map	application/json	5.4 kB