UNPKG

node-llama-cpp

Version:

Run AI models locally on your machine with node.js bindings for llama.cpp. Enforce a JSON schema on the model output on the generation level

node-llama-cpp.withcat.ai

withcatai/node-llama-cpp

2 folders, 42 files
../
generic/
134 kB
utils/
90.2 kB
AlpacaChatWrapper.d.ts
749 B
AlpacaChatWrapper.js
1.28 kB
AlpacaChatWrapper.js.map
947 B
ChatMLChatWrapper.d.ts
411 B
ChatMLChatWrapper.js
3.56 kB
ChatMLChatWrapper.js.map
2.87 kB
DeepSeekChatWrapper.d.ts
1.76 kB
DeepSeekChatWrapper.js
17.3 kB
DeepSeekChatWrapper.js.map
9.38 kB
EmptyChatWrapper.d.ts
145 B
EmptyChatWrapper.js
174 B
EmptyChatWrapper.js.map
246 B
FalconChatWrapper.d.ts
994 B
FalconChatWrapper.js
5.53 kB
FalconChatWrapper.js.map
4.28 kB
FunctionaryChatWrapper.d.ts
1.07 kB
FunctionaryChatWrapper.js
29.8 kB
FunctionaryChatWrapper.js.map
19.8 kB
GemmaChatWrapper.d.ts
475 B
GemmaChatWrapper.js
4.01 kB
GemmaChatWrapper.js.map
3.07 kB
GeneralChatWrapper.d.ts
995 B
GeneralChatWrapper.js
6.63 kB
GeneralChatWrapper.js.map
5.08 kB
Llama2ChatWrapper.d.ts
551 B
Llama2ChatWrapper.js
3.81 kB
Llama2ChatWrapper.js.map
3.04 kB
Llama3ChatWrapper.d.ts
838 B
Llama3ChatWrapper.js
8.06 kB
Llama3ChatWrapper.js.map
5.09 kB
Llama3_1ChatWrapper.d.ts
1.62 kB
Llama3_1ChatWrapper.js
13.6 kB
Llama3_1ChatWrapper.js.map
10.4 kB
Llama3_2LightweightChatWrapper.d.ts
1.67 kB
Llama3_2LightweightChatWrapper.js
12.5 kB
Llama3_2LightweightChatWrapper.js.map
9.69 kB
MistralChatWrapper.d.ts
1.02 kB
MistralChatWrapper.js
8.15 kB
MistralChatWrapper.js.map
6.22 kB
QwenChatWrapper.d.ts
1.08 kB
QwenChatWrapper.js
7.31 kB
QwenChatWrapper.js.map
5.41 kB