node-llama-cpp

Version:

Run AI models locally on your machine with node.js bindings for llama.cpp. Enforce a JSON schema on the model output on the generation level

5 folders, 27 files

Filename	Content Type	Size
../
LlamaChat/	–	296 kB
LlamaChatSession/	–	95.9 kB
LlamaContext/	–	236 kB
LlamaModel/	–	82.1 kB
utils/	–	22.9 kB
LlamaCompletion.d.ts	text/typescript	10.3 kB
LlamaCompletion.js	text/javascript	26.3 kB
LlamaCompletion.js.map	application/json	19.4 kB
LlamaEmbedding.d.ts	text/typescript	842 B
LlamaEmbedding.js	text/javascript	1.89 kB
LlamaEmbedding.js.map	application/json	1.65 kB
LlamaEmbeddingContext.d.ts	text/typescript	2.06 kB
LlamaEmbeddingContext.js	text/javascript	3.82 kB
LlamaEmbeddingContext.js.map	application/json	3.18 kB
LlamaGrammar.d.ts	text/typescript	1.75 kB
LlamaGrammar.js	text/javascript	2.78 kB
LlamaGrammar.js.map	application/json	1.99 kB
LlamaGrammarEvaluationState.d.ts	text/typescript	844 B
LlamaGrammarEvaluationState.js	text/javascript	1.34 kB
LlamaGrammarEvaluationState.js.map	application/json	890 B
LlamaJsonSchemaGrammar.d.ts	text/typescript	1.02 kB
LlamaJsonSchemaGrammar.js	text/javascript	1.5 kB
LlamaJsonSchemaGrammar.js.map	application/json	920 B
LlamaRankingContext.d.ts	text/typescript	4.1 kB
LlamaRankingContext.js	text/javascript	9.03 kB
LlamaRankingContext.js.map	application/json	7.12 kB
TokenBias.d.ts	text/typescript	1.73 kB
TokenBias.js	text/javascript	2.71 kB
TokenBias.js.map	application/json	1.49 kB
TokenMeter.d.ts	text/typescript	1.28 kB
TokenMeter.js	text/javascript	1.91 kB
TokenMeter.js.map	application/json	1.43 kB