UNPKG

node-llama-cpp

Version:

Run AI models locally on your machine with node.js bindings for llama.cpp. Enforce a JSON schema on the model output on the generation level

node-llama-cpp.withcat.ai

withcatai/node-llama-cpp

6 folders, 25 files

	Filename	Content Type	Size
	../
	bindings/	–	310 kB
	chatWrappers/	–	523 kB
	cli/	–	534 kB
	evaluator/	–	825 kB
	gguf/	–	254 kB
	utils/	–	590 kB
	ChatWrapper.d.ts	text/typescript	2.14 kB
	ChatWrapper.js	text/javascript	11.1 kB
	ChatWrapper.js.map	application/json	8.96 kB
	apiDocsIndex.d.ts	text/typescript	11 B
	apiDocsIndex.js	text/javascript	206 B
	apiDocsIndex.js.map	application/json	259 B
	commands.d.ts	text/typescript	498 B
	commands.js	text/javascript	579 B
	commands.js.map	application/json	442 B
	config.d.ts	text/typescript	3.34 kB
	config.js	text/javascript	6.24 kB
	config.js.map	application/json	5.06 kB
	consts.d.ts	text/typescript	187 B
	consts.js	text/javascript	363 B
	consts.js.map	application/json	430 B
	index.d.ts	text/typescript	15 kB
	index.js	text/javascript	7.07 kB
	index.js.map	application/json	4.17 kB
	state.d.ts	text/typescript	397 B
	state.js	text/javascript	610 B
	state.js.map	application/json	575 B
	tsconfig.tsbuildinfo	application/octet-stream	12 kB
	types.d.ts	text/typescript	13.1 kB
	types.js	text/javascript	431 B
	types.js.map	application/json	501 B