node-llama-cpp

Version:

Run AI models locally on your machine with node.js bindings for llama.cpp. Enforce a JSON schema on the model output on the generation level

3 files

Filename	Content Type	Size
../
eraseFirstResponseAndKeepFirstSystemChatContextShiftStrategy.d.ts	text/typescript	616 B
eraseFirstResponseAndKeepFirstSystemChatContextShiftStrategy.js	text/javascript	14.6 kB
eraseFirstResponseAndKeepFirstSystemChatContextShiftStrategy.js.map	application/json	10.2 kB