UNPKG

node-llama-cpp

Version:

Run AI models locally on your machine with node.js bindings for llama.cpp. Enforce a JSON schema on the model output on the generation level

node-llama-cpp.withcat.ai

withcatai/node-llama-cpp

2 folders, 39 files
../
generic/
62.6 kB
utils/
74.8 kB
AlpacaChatWrapper.d.ts
749 B
AlpacaChatWrapper.js
1.28 kB
AlpacaChatWrapper.js.map
948 B
ChatMLChatWrapper.d.ts
411 B
ChatMLChatWrapper.js
3.56 kB
ChatMLChatWrapper.js.map
2.87 kB
DeepSeekChatWrapper.d.ts
1.76 kB
DeepSeekChatWrapper.js
17 kB
DeepSeekChatWrapper.js.map
9.06 kB
EmptyChatWrapper.d.ts
145 B
EmptyChatWrapper.js
174 B
EmptyChatWrapper.js.map
246 B
FalconChatWrapper.d.ts
994 B
FalconChatWrapper.js
5.53 kB
FalconChatWrapper.js.map
4.28 kB
FunctionaryChatWrapper.d.ts
1.07 kB
FunctionaryChatWrapper.js
29.8 kB
FunctionaryChatWrapper.js.map
19.8 kB
GemmaChatWrapper.d.ts
475 B
GemmaChatWrapper.js
4.01 kB
GemmaChatWrapper.js.map
3.07 kB
GeneralChatWrapper.d.ts
995 B
GeneralChatWrapper.js
6.63 kB
GeneralChatWrapper.js.map
5.08 kB
Llama2ChatWrapper.d.ts
551 B
Llama2ChatWrapper.js
3.81 kB
Llama2ChatWrapper.js.map
3.05 kB
Llama3ChatWrapper.d.ts
838 B
Llama3ChatWrapper.js
8.06 kB
Llama3ChatWrapper.js.map
5.09 kB
Llama3_1ChatWrapper.d.ts
1.62 kB
Llama3_1ChatWrapper.js
13 kB
Llama3_1ChatWrapper.js.map
10 kB
Llama3_2LightweightChatWrapper.d.ts
1.67 kB
Llama3_2LightweightChatWrapper.js
11.8 kB
Llama3_2LightweightChatWrapper.js.map
9.32 kB
MistralChatWrapper.d.ts
902 B
MistralChatWrapper.js
6.9 kB
MistralChatWrapper.js.map
5.24 kB