@isdk/ai-tool-llm-llamacpp/docs/interfaces/LlamaModelSettings.md

llama.cpp LLM Provider

[**@isdk/ai-tool-llm-llamacpp**](../README.md)

***

[@isdk/ai-tool-llm-llamacpp](../globals.md) / LlamaModelSettings

# Interface: LlamaModelSettings

Defined in: [packages/ai-tool-llm-llamacpp/src/options.ts:488](https://github.com/isdk/ai-tool-llm-llamacpp.js/blob/151b8bdfe7d8b8a8be547948f716da692b2f3c67/src/options.ts#L488)

## Indexable

\[`name`: `string`\]: `any`

## Properties

### arch?

> `optional` **arch**: [`LlmArch`](../enumerations/LlmArch.md)

Defined in: [packages/ai-tool-llm-llamacpp/src/options.ts:491](https://github.com/isdk/ai-tool-llm-llamacpp.js/blob/151b8bdfe7d8b8a8be547948f716da692b2f3c67/src/options.ts#L491)

***

### chat\_template?

> `optional` **chat\_template**: `string`

Defined in: [packages/ai-tool-llm-llamacpp/src/options.ts:509](https://github.com/isdk/ai-tool-llm-llamacpp.js/blob/151b8bdfe7d8b8a8be547948f716da692b2f3c67/src/options.ts#L509)

***

### model

> **model**: `string`

Defined in: [packages/ai-tool-llm-llamacpp/src/options.ts:489](https://github.com/isdk/ai-tool-llm-llamacpp.js/blob/151b8bdfe7d8b8a8be547948f716da692b2f3c67/src/options.ts#L489)

***

### n\_ctx\_train?

> `optional` **n\_ctx\_train**: `number`

Defined in: [packages/ai-tool-llm-llamacpp/src/options.ts:499](https://github.com/isdk/ai-tool-llm-llamacpp.js/blob/151b8bdfe7d8b8a8be547948f716da692b2f3c67/src/options.ts#L499)

the content length in train

***

### n\_embd?

> `optional` **n\_embd**: `number`

Defined in: [packages/ai-tool-llm-llamacpp/src/options.ts:508](https://github.com/isdk/ai-tool-llm-llamacpp.js/blob/151b8bdfe7d8b8a8be547948f716da692b2f3c67/src/options.ts#L508)

***

### n\_params?

> `optional` **n\_params**: `number`

Defined in: [packages/ai-tool-llm-llamacpp/src/options.ts:503](https://github.com/isdk/ai-tool-llm-llamacpp.js/blob/151b8bdfe7d8b8a8be547948f716da692b2f3c67/src/options.ts#L503)

the model params size in bytes

***

### n\_vocab?

> `optional` **n\_vocab**: `number`

Defined in: [packages/ai-tool-llm-llamacpp/src/options.ts:507](https://github.com/isdk/ai-tool-llm-llamacpp.js/blob/151b8bdfe7d8b8a8be547948f716da692b2f3c67/src/options.ts#L507)

the quanted model size in bytes

***

### quant?

> `optional` **quant**: `AIModelQuantType`

Defined in: [packages/ai-tool-llm-llamacpp/src/options.ts:494](https://github.com/isdk/ai-tool-llm-llamacpp.js/blob/151b8bdfe7d8b8a8be547948f716da692b2f3c67/src/options.ts#L494)

***

### size?

> `optional` **size**: `number`

Defined in: [packages/ai-tool-llm-llamacpp/src/options.ts:493](https://github.com/isdk/ai-tool-llm-llamacpp.js/blob/151b8bdfe7d8b8a8be547948f716da692b2f3c67/src/options.ts#L493)

***

### size\_type?

> `optional` **size\_type**: [`LlmSizeType`](../enumerations/LlmSizeType.md)

Defined in: [packages/ai-tool-llm-llamacpp/src/options.ts:492](https://github.com/isdk/ai-tool-llm-llamacpp.js/blob/151b8bdfe7d8b8a8be547948f716da692b2f3c67/src/options.ts#L492)

***

### state?

> `optional` **state**: `LlamaCppServerState`

Defined in: [packages/ai-tool-llm-llamacpp/src/options.ts:490](https://github.com/isdk/ai-tool-llm-llamacpp.js/blob/151b8bdfe7d8b8a8be547948f716da692b2f3c67/src/options.ts#L490)

***

### vocab\_type?

> `optional` **vocab\_type**: [`LlamaVocabType`](../enumerations/LlamaVocabType.md)

Defined in: [packages/ai-tool-llm-llamacpp/src/options.ts:495](https://github.com/isdk/ai-tool-llm-llamacpp.js/blob/151b8bdfe7d8b8a8be547948f716da692b2f3c67/src/options.ts#L495)