UNPKG

@isdk/ai-tool-llm-llamacpp

Version:

llama.cpp LLM Provider

github.com/isdk/ai-tool-llm-llamacpp.js

isdk/ai-tool-llm-llamacpp.js

12 lines (6 loc) • 440 B
1
2
3
4
5
6
7
8
9
10
11
12
[**@isdk/ai-tool-llm-llamacpp**](../README.md) *** [@isdk/ai-tool-llm-llamacpp](../globals.md) / LlamaCacheQuantType # Type Alias: LlamaCacheQuantType > **LlamaCacheQuantType**: `"f32"` \| `"f16"` \| `"q8_0"` \| `"q4_0"` \| `"q4_1"` \| `"q5_0"` \| `"q5_1"` Defined in: [packages/ai-tool-llm-llamacpp/src/options.ts:143](https://github.com/isdk/ai-tool-llm-llamacpp.js/blob/151b8bdfe7d8b8a8be547948f716da692b2f3c67/src/options.ts#L143)