UNPKG

@isdk/ai-tool-llm-llamacpp

Version:

llama.cpp LLM Provider

github.com/isdk/ai-tool-llm-llamacpp.js

isdk/ai-tool-llm-llamacpp.js

74 lines (37 loc) • 2.27 kB
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
[**@isdk/ai-tool-llm-llamacpp**](../README.md) *** [@isdk/ai-tool-llm-llamacpp](../globals.md) / LLamaCppModelTimings # Interface: LLamaCppModelTimings Defined in: [packages/ai-tool-llm-llamacpp/src/options.ts:524](https://github.com/isdk/ai-tool-llm-llamacpp.js/blob/151b8bdfe7d8b8a8be547948f716da692b2f3c67/src/options.ts#L524) ## Properties ### predicted\_ms > **predicted\_ms**: `number` Defined in: [packages/ai-tool-llm-llamacpp/src/options.ts:525](https://github.com/isdk/ai-tool-llm-llamacpp.js/blob/151b8bdfe7d8b8a8be547948f716da692b2f3c67/src/options.ts#L525) *** ### predicted\_n > **predicted\_n**: `number` Defined in: [packages/ai-tool-llm-llamacpp/src/options.ts:526](https://github.com/isdk/ai-tool-llm-llamacpp.js/blob/151b8bdfe7d8b8a8be547948f716da692b2f3c67/src/options.ts#L526) *** ### predicted\_per\_second > **predicted\_per\_second**: `number` Defined in: [packages/ai-tool-llm-llamacpp/src/options.ts:527](https://github.com/isdk/ai-tool-llm-llamacpp.js/blob/151b8bdfe7d8b8a8be547948f716da692b2f3c67/src/options.ts#L527) *** ### predicted\_per\_token\_ms > **predicted\_per\_token\_ms**: `number` Defined in: [packages/ai-tool-llm-llamacpp/src/options.ts:528](https://github.com/isdk/ai-tool-llm-llamacpp.js/blob/151b8bdfe7d8b8a8be547948f716da692b2f3c67/src/options.ts#L528) *** ### prompt\_ms > **prompt\_ms**: `number` Defined in: [packages/ai-tool-llm-llamacpp/src/options.ts:529](https://github.com/isdk/ai-tool-llm-llamacpp.js/blob/151b8bdfe7d8b8a8be547948f716da692b2f3c67/src/options.ts#L529) *** ### prompt\_n > **prompt\_n**: `number` Defined in: [packages/ai-tool-llm-llamacpp/src/options.ts:530](https://github.com/isdk/ai-tool-llm-llamacpp.js/blob/151b8bdfe7d8b8a8be547948f716da692b2f3c67/src/options.ts#L530) *** ### prompt\_per\_second > **prompt\_per\_second**: `number` Defined in: [packages/ai-tool-llm-llamacpp/src/options.ts:531](https://github.com/isdk/ai-tool-llm-llamacpp.js/blob/151b8bdfe7d8b8a8be547948f716da692b2f3c67/src/options.ts#L531) *** ### prompt\_per\_token\_ms > **prompt\_per\_token\_ms**: `number` Defined in: [packages/ai-tool-llm-llamacpp/src/options.ts:532](https://github.com/isdk/ai-tool-llm-llamacpp.js/blob/151b8bdfe7d8b8a8be547948f716da692b2f3c67/src/options.ts#L532)