UNPKG

@isdk/ai-tool-llm-llamacpp-pro

Version:

llama.cpp LLM Provider

github.com/isdk/ai-tool-llm-llamacpp.js

isdk/ai-tool-llm-llamacpp.js

74 lines (37 loc) • 2.34 kB
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
[**@isdk/ai-tool-llm-llamacpp-pro**](../README.md) *** [@isdk/ai-tool-llm-llamacpp-pro](../globals.md) / LLamaCppModelTimings # Interface: LLamaCppModelTimings Defined in: [packages/ai-tool-llm-llamacpp-pro/src/options.ts:339](https://github.com/isdk/ai-tool-llm-llamacpppro.js/blob/9c0ca0e3e655313e1ab7404ee1b7bd6f7999d23f/src/options.ts#L339) ## Properties ### predicted\_ms > **predicted\_ms**: `number` Defined in: [packages/ai-tool-llm-llamacpp-pro/src/options.ts:340](https://github.com/isdk/ai-tool-llm-llamacpppro.js/blob/9c0ca0e3e655313e1ab7404ee1b7bd6f7999d23f/src/options.ts#L340) *** ### predicted\_n > **predicted\_n**: `number` Defined in: [packages/ai-tool-llm-llamacpp-pro/src/options.ts:341](https://github.com/isdk/ai-tool-llm-llamacpppro.js/blob/9c0ca0e3e655313e1ab7404ee1b7bd6f7999d23f/src/options.ts#L341) *** ### predicted\_per\_second > **predicted\_per\_second**: `number` Defined in: [packages/ai-tool-llm-llamacpp-pro/src/options.ts:342](https://github.com/isdk/ai-tool-llm-llamacpppro.js/blob/9c0ca0e3e655313e1ab7404ee1b7bd6f7999d23f/src/options.ts#L342) *** ### predicted\_per\_token\_ms > **predicted\_per\_token\_ms**: `number` Defined in: [packages/ai-tool-llm-llamacpp-pro/src/options.ts:343](https://github.com/isdk/ai-tool-llm-llamacpppro.js/blob/9c0ca0e3e655313e1ab7404ee1b7bd6f7999d23f/src/options.ts#L343) *** ### prompt\_ms > **prompt\_ms**: `number` Defined in: [packages/ai-tool-llm-llamacpp-pro/src/options.ts:344](https://github.com/isdk/ai-tool-llm-llamacpppro.js/blob/9c0ca0e3e655313e1ab7404ee1b7bd6f7999d23f/src/options.ts#L344) *** ### prompt\_n > **prompt\_n**: `number` Defined in: [packages/ai-tool-llm-llamacpp-pro/src/options.ts:345](https://github.com/isdk/ai-tool-llm-llamacpppro.js/blob/9c0ca0e3e655313e1ab7404ee1b7bd6f7999d23f/src/options.ts#L345) *** ### prompt\_per\_second > **prompt\_per\_second**: `number` Defined in: [packages/ai-tool-llm-llamacpp-pro/src/options.ts:346](https://github.com/isdk/ai-tool-llm-llamacpppro.js/blob/9c0ca0e3e655313e1ab7404ee1b7bd6f7999d23f/src/options.ts#L346) *** ### prompt\_per\_token\_ms > **prompt\_per\_token\_ms**: `number` Defined in: [packages/ai-tool-llm-llamacpp-pro/src/options.ts:347](https://github.com/isdk/ai-tool-llm-llamacpppro.js/blob/9c0ca0e3e655313e1ab7404ee1b7bd6f7999d23f/src/options.ts#L347)