node-llama-cpp

Version:

Run AI models locally on your machine with node.js bindings for llama.cpp. Enforce a JSON schema on the model output on the generation level

5 folders, 27 files

Filename	Content Type	Size
../
LlamaChat/	–	249 kB
LlamaChatSession/	–	74.2 kB
LlamaContext/	–	214 kB
LlamaModel/	–	81 kB
utils/	–	22.9 kB
LlamaCompletion.d.ts	text/typescript	8.03 kB
LlamaCompletion.js	text/javascript	25.8 kB
LlamaCompletion.js.map	application/json	19 kB
LlamaEmbedding.d.ts	text/typescript	842 B
LlamaEmbedding.js	text/javascript	1.89 kB
LlamaEmbedding.js.map	application/json	1.65 kB
LlamaEmbeddingContext.d.ts	text/typescript	2.06 kB
LlamaEmbeddingContext.js	text/javascript	3.82 kB
LlamaEmbeddingContext.js.map	application/json	3.17 kB
LlamaGrammar.d.ts	text/typescript	1.75 kB
LlamaGrammar.js	text/javascript	2.78 kB
LlamaGrammar.js.map	application/json	1.99 kB
LlamaGrammarEvaluationState.d.ts	text/typescript	844 B
LlamaGrammarEvaluationState.js	text/javascript	1.34 kB
LlamaGrammarEvaluationState.js.map	application/json	890 B
LlamaJsonSchemaGrammar.d.ts	text/typescript	909 B
LlamaJsonSchemaGrammar.js	text/javascript	1.5 kB
LlamaJsonSchemaGrammar.js.map	application/json	922 B
LlamaRankingContext.d.ts	text/typescript	3.41 kB
LlamaRankingContext.js	text/javascript	7.47 kB
LlamaRankingContext.js.map	application/json	5.81 kB
TokenBias.d.ts	text/typescript	1.73 kB
TokenBias.js	text/javascript	2.71 kB
TokenBias.js.map	application/json	1.49 kB
TokenMeter.d.ts	text/typescript	1.28 kB
TokenMeter.js	text/javascript	1.91 kB
TokenMeter.js.map	application/json	1.43 kB