UNPKG

node-llama-cpp

Version:

Run AI models locally on your machine with node.js bindings for llama.cpp. Enforce a JSON schema on the model output on the generation level

node-llama-cpp.withcat.ai

withcatai/node-llama-cpp

2 folders, 48 files
../
generic/
143 kB
utils/
93.9 kB
AlpacaChatWrapper.d.ts
749 B
AlpacaChatWrapper.js
1.28 kB
AlpacaChatWrapper.js.map
947 B
ChatMLChatWrapper.d.ts
411 B
ChatMLChatWrapper.js
3.56 kB
ChatMLChatWrapper.js.map
2.87 kB
DeepSeekChatWrapper.d.ts
1.76 kB
DeepSeekChatWrapper.js
17.3 kB
DeepSeekChatWrapper.js.map
9.38 kB
EmptyChatWrapper.d.ts
145 B
EmptyChatWrapper.js
174 B
EmptyChatWrapper.js.map
246 B
FalconChatWrapper.d.ts
994 B
FalconChatWrapper.js
5.53 kB
FalconChatWrapper.js.map
4.28 kB
FunctionaryChatWrapper.d.ts
1.07 kB
FunctionaryChatWrapper.js
30 kB
FunctionaryChatWrapper.js.map
19.8 kB
GemmaChatWrapper.d.ts
475 B
GemmaChatWrapper.js
4.01 kB
GemmaChatWrapper.js.map
3.07 kB
GeneralChatWrapper.d.ts
995 B
GeneralChatWrapper.js
6.63 kB
GeneralChatWrapper.js.map
5.08 kB
HarmonyChatWrapper.d.ts
3.1 kB
HarmonyChatWrapper.js
24.3 kB
HarmonyChatWrapper.js.map
17.5 kB
Llama2ChatWrapper.d.ts
551 B
Llama2ChatWrapper.js
3.81 kB
Llama2ChatWrapper.js.map
3.04 kB
Llama3ChatWrapper.d.ts
838 B
Llama3ChatWrapper.js
8.14 kB
Llama3ChatWrapper.js.map
5.1 kB
Llama3_1ChatWrapper.d.ts
1.62 kB
Llama3_1ChatWrapper.js
13.7 kB
Llama3_1ChatWrapper.js.map
10.3 kB
Llama3_2LightweightChatWrapper.d.ts
1.67 kB
Llama3_2LightweightChatWrapper.js
12.5 kB
Llama3_2LightweightChatWrapper.js.map
9.64 kB
MistralChatWrapper.d.ts
1.02 kB
MistralChatWrapper.js
8.15 kB
MistralChatWrapper.js.map
6.22 kB
QwenChatWrapper.d.ts
1.3 kB
QwenChatWrapper.js
9.31 kB
QwenChatWrapper.js.map
6.87 kB
SeedChatWrapper.d.ts
1.2 kB
SeedChatWrapper.js
9.1 kB
SeedChatWrapper.js.map
5.9 kB