ai
Version:
AI SDK by Vercel - The AI Toolkit for TypeScript and JavaScript
47 lines (38 loc) • 1.51 kB
text/mdx
title: LanguageModelV3Middleware
description: Middleware for enhancing language model behavior (API Reference)
# `LanguageModelV3Middleware`
<Note type="warning">
Language model middleware is an experimental feature.
</Note>
Language model middleware provides a way to enhance the behavior of language models
by intercepting and modifying the calls to the language model. It can be used to add
features like guardrails, RAG, caching, and logging in a language model agnostic way.
See [Language Model Middleware](/docs/ai-sdk-core/middleware) for more information.
## Import
<Snippet
text={`import { LanguageModelV3Middleware } from "ai"`}
prompt={false}
/>
## API Signature
<PropertiesTable
content={[
{
name: 'transformParams',
type: '({ type: "generate" | "stream", params: LanguageModelV3CallOptions }) => Promise<LanguageModelV3CallOptions>',
description:
'Transforms the parameters before they are passed to the language model.',
},
{
name: 'wrapGenerate',
type: '({ doGenerate: DoGenerateFunction, params: LanguageModelV3CallOptions, model: LanguageModelV3 }) => Promise<DoGenerateResult>',
description: 'Wraps the generate operation of the language model.',
},
{
name: 'wrapStream',
type: '({ doStream: DoStreamFunction, params: LanguageModelV3CallOptions, model: LanguageModelV3 }) => Promise<DoStreamResult>',
description: 'Wraps the stream operation of the language model.',
},
]}
/>