@isdk/ai-tool-llm-llamacpp-pro/docs/interfaces/LlamaModelSettings.md

llama.cpp LLM Provider

[**@isdk/ai-tool-llm-llamacpp-pro**](../README.md)

***

[@isdk/ai-tool-llm-llamacpp-pro](../globals.md) / LlamaModelSettings

# Interface: LlamaModelSettings

Defined in: [packages/ai-tool-llm-llamacpp-pro/src/options.ts:303](https://github.com/isdk/ai-tool-llm-llamacpppro.js/blob/9c0ca0e3e655313e1ab7404ee1b7bd6f7999d23f/src/options.ts#L303)

## Indexable

\[`name`: `string`\]: `any`

## Properties

### arch?

> `optional` **arch**: [`LlmArch`](../enumerations/LlmArch.md)

Defined in: [packages/ai-tool-llm-llamacpp-pro/src/options.ts:306](https://github.com/isdk/ai-tool-llm-llamacpppro.js/blob/9c0ca0e3e655313e1ab7404ee1b7bd6f7999d23f/src/options.ts#L306)

***

### chat\_template?

> `optional` **chat\_template**: `string`

Defined in: [packages/ai-tool-llm-llamacpp-pro/src/options.ts:324](https://github.com/isdk/ai-tool-llm-llamacpppro.js/blob/9c0ca0e3e655313e1ab7404ee1b7bd6f7999d23f/src/options.ts#L324)

***

### model

> **model**: `string`

Defined in: [packages/ai-tool-llm-llamacpp-pro/src/options.ts:304](https://github.com/isdk/ai-tool-llm-llamacpppro.js/blob/9c0ca0e3e655313e1ab7404ee1b7bd6f7999d23f/src/options.ts#L304)

***

### n\_ctx\_train?

> `optional` **n\_ctx\_train**: `number`

Defined in: [packages/ai-tool-llm-llamacpp-pro/src/options.ts:314](https://github.com/isdk/ai-tool-llm-llamacpppro.js/blob/9c0ca0e3e655313e1ab7404ee1b7bd6f7999d23f/src/options.ts#L314)

the content length in train

***

### n\_embd?

> `optional` **n\_embd**: `number`

Defined in: [packages/ai-tool-llm-llamacpp-pro/src/options.ts:323](https://github.com/isdk/ai-tool-llm-llamacpppro.js/blob/9c0ca0e3e655313e1ab7404ee1b7bd6f7999d23f/src/options.ts#L323)

***

### n\_params?

> `optional` **n\_params**: `number`

Defined in: [packages/ai-tool-llm-llamacpp-pro/src/options.ts:318](https://github.com/isdk/ai-tool-llm-llamacpppro.js/blob/9c0ca0e3e655313e1ab7404ee1b7bd6f7999d23f/src/options.ts#L318)

the model params size in bytes

***

### n\_vocab?

> `optional` **n\_vocab**: `number`

Defined in: [packages/ai-tool-llm-llamacpp-pro/src/options.ts:322](https://github.com/isdk/ai-tool-llm-llamacpppro.js/blob/9c0ca0e3e655313e1ab7404ee1b7bd6f7999d23f/src/options.ts#L322)

the quanted model size in bytes

***

### quant?

> `optional` **quant**: `AIModelQuantType`

Defined in: [packages/ai-tool-llm-llamacpp-pro/src/options.ts:309](https://github.com/isdk/ai-tool-llm-llamacpppro.js/blob/9c0ca0e3e655313e1ab7404ee1b7bd6f7999d23f/src/options.ts#L309)

***

### size?

> `optional` **size**: `number`

Defined in: [packages/ai-tool-llm-llamacpp-pro/src/options.ts:308](https://github.com/isdk/ai-tool-llm-llamacpppro.js/blob/9c0ca0e3e655313e1ab7404ee1b7bd6f7999d23f/src/options.ts#L308)

***

### size\_type?

> `optional` **size\_type**: [`LlmSizeType`](../enumerations/LlmSizeType.md)

Defined in: [packages/ai-tool-llm-llamacpp-pro/src/options.ts:307](https://github.com/isdk/ai-tool-llm-llamacpppro.js/blob/9c0ca0e3e655313e1ab7404ee1b7bd6f7999d23f/src/options.ts#L307)

***

### state?

> `optional` **state**: `LlamaCppServerState`

Defined in: [packages/ai-tool-llm-llamacpp-pro/src/options.ts:305](https://github.com/isdk/ai-tool-llm-llamacpppro.js/blob/9c0ca0e3e655313e1ab7404ee1b7bd6f7999d23f/src/options.ts#L305)

***

### vocab\_type?

> `optional` **vocab\_type**: [`LlamaVocabType`](../enumerations/LlamaVocabType.md)

Defined in: [packages/ai-tool-llm-llamacpp-pro/src/options.ts:310](https://github.com/isdk/ai-tool-llm-llamacpppro.js/blob/9c0ca0e3e655313e1ab7404ee1b7bd6f7999d23f/src/options.ts#L310)