UNPKG

node-llama-cpp

Version:

Run AI models locally on your machine with node.js bindings for llama.cpp. Enforce a JSON schema on the model output on the generation level

node-llama-cpp.withcat.ai

withcatai/node-llama-cpp

2 folders, 12 files

	Filename	Content Type	Size
	../
	tokenPredictors/	–	39.3 kB
	utils/	–	8.93 kB
	LlamaContext.d.ts	text/typescript	12.8 kB
	LlamaContext.js	text/javascript	83.4 kB
	LlamaContext.js.map	application/json	58.5 kB
	LlamaSampler.d.ts	text/typescript	11 B
	LlamaSampler.js	text/javascript	1.12 kB
	LlamaSampler.js.map	application/json	1.15 kB
	TokenPredictor.d.ts	text/typescript	2.39 kB
	TokenPredictor.js	text/javascript	722 B
	TokenPredictor.js.map	application/json	386 B
	types.d.ts	text/typescript	19.5 kB
	types.js	text/javascript	44 B
	types.js.map	application/json	131 B