@isdk/ai-tool-llm-llamacpp-pro
Version:
llama.cpp LLM Provider
53 lines (38 loc) • 1.8 kB
Markdown
[**@isdk/ai-tool-llm-llamacpp-pro**](README.md)
***
# @isdk/ai-tool-llm-llamacpp-pro
## Enumerations
- [LlamaVocabType](enumerations/LlamaVocabType.md)
- [LlmArch](enumerations/LlmArch.md)
- [LlmSizeType](enumerations/LlmSizeType.md)
## Classes
- [LlamaCppProvider](classes/LlamaCppProvider.md)
## Interfaces
- [LLamaCppModelGenerationSettings](interfaces/LLamaCppModelGenerationSettings.md)
- [LLamaCppModelTimings](interfaces/LLamaCppModelTimings.md)
- [LLamaCppPartResult](interfaces/LLamaCppPartResult.md)
- [LLamaCppResult](interfaces/LLamaCppResult.md)
- [LlamaLavaModelSettings](interfaces/LlamaLavaModelSettings.md)
- [LlamaLoadModelOptions](interfaces/LlamaLoadModelOptions.md)
- [LlamaModelOptions](interfaces/LlamaModelOptions.md)
- [LlamaModelSettings](interfaces/LlamaModelSettings.md)
- [LoraItemObject](interfaces/LoraItemObject.md)
## Type Aliases
- [LlamaCacheQuantType](type-aliases/LlamaCacheQuantType.md)
- [LlamaCppAIResult](type-aliases/LlamaCppAIResult.md)
- [LlamaCppAIStreamParser](type-aliases/LlamaCppAIStreamParser.md)
- [LlamaRopeScalingType](type-aliases/LlamaRopeScalingType.md)
- [LoraItem](type-aliases/LoraItem.md)
- [LoraItems](type-aliases/LoraItems.md)
## Variables
- [AILoadModelOptionsMap](variables/AILoadModelOptionsMap.md)
- [AIModelSettingsMap](variables/AIModelSettingsMap.md)
- [AIOptionsMap](variables/AIOptionsMap.md)
- [llamaCpp](variables/llamaCpp.md)
- [LlamaCppProviderName](variables/LlamaCppProviderName.md)
- [LlamaLoadModelOptionsKeys](variables/LlamaLoadModelOptionsKeys.md)
- [ReverseAILoadModelOptions](variables/ReverseAILoadModelOptions.md)
- [ReverseAIOptionsMap](variables/ReverseAIOptionsMap.md)
## Functions
- [llamaCppToAIResult](functions/llamaCppToAIResult.md)
- [parseLlamaCppStream](functions/parseLlamaCppStream.md)