UNPKG

@isdk/ai-tool-llm-llamacpp-pro

Version:

llama.cpp LLM Provider

github.com/isdk/ai-tool-llm-llamacpp.js

isdk/ai-tool-llm-llamacpp.js

12 lines (6 loc) • 455 B
1
2
3
4
5
6
7
8
9
10
11
12
[**@isdk/ai-tool-llm-llamacpp-pro**](../README.md) *** [@isdk/ai-tool-llm-llamacpp-pro](../globals.md) / LlamaCacheQuantType # Type Alias: LlamaCacheQuantType > **LlamaCacheQuantType**: `"f32"` \| `"f16"` \| `"q8_0"` \| `"q4_0"` \| `"q4_1"` \| `"q5_0"` \| `"q5_1"` Defined in: [packages/ai-tool-llm-llamacpp-pro/src/options.ts:143](https://github.com/isdk/ai-tool-llm-llamacpppro.js/blob/9c0ca0e3e655313e1ab7404ee1b7bd6f7999d23f/src/options.ts#L143)