UNPKG

node-llama-cpp

Version:

Run AI models locally on your machine with node.js bindings for llama.cpp. Enforce a JSON schema on the model output on the generation level

node-llama-cpp.withcat.ai

withcatai/node-llama-cpp

2 folders, 12 files

	Filename	Content Type	Size
	../
	tokenPredictors/	–	39.4 kB
	utils/	–	8.93 kB
	LlamaContext.d.ts	text/typescript	12.8 kB
	LlamaContext.js	text/javascript	84.4 kB
	LlamaContext.js.map	application/json	59.2 kB
	LlamaSampler.d.ts	text/typescript	11 B
	LlamaSampler.js	text/javascript	1.63 kB
	LlamaSampler.js.map	application/json	1.48 kB
	TokenPredictor.d.ts	text/typescript	2.39 kB
	TokenPredictor.js	text/javascript	722 B
	TokenPredictor.js.map	application/json	386 B
	types.d.ts	text/typescript	24.9 kB
	types.js	text/javascript	44 B
	types.js.map	application/json	131 B