UNPKG

@tanstack/ai

Version:

Type-safe TypeScript AI SDK for streaming chat, tool calling, agents, structured outputs, and multimodal generation.

tanstack.com/ai

TanStack/ai

21 lines (20 loc) • 1.04 kB
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
/** * Single source of truth for the provider-native key spellings that cap output * tokens. Sampling options live in opaque, provider-native `modelOptions`, and * every provider spells the token cap differently. Two call sites must agree on * this set or they silently drift: * * - `activities/summarize/chat-stream-summarize.ts` — detects a caller-supplied * token limit so the summarize default never overrides it. * - `middlewares/otel.ts` — picks the first numeric spelling to populate the * `gen_ai.request.max_tokens` attribute across providers. * * Keep this list in lockstep with `MAX_TOKENS_KEY_BY_ADAPTER` (the adapter → * native-key map) in the summarize wrapper. */ export declare const MAX_TOKENS_KEYS: readonly ["max_output_tokens", "max_tokens", "max_completion_tokens", "maxOutputTokens", "maxCompletionTokens", "maxTokens"]; /** * Ollama nests sampling under `options`; its token cap is `options.num_predict` * rather than a flat key. */ export declare const NESTED_MAX_TOKENS_KEY: "num_predict";