@juspay/neurolink
Version:
The pipe layer of an AI nervous system: one interface connecting provider neurons to your application, across three inference types — generate, stream and decide. `decide` returns typed, calibrated judgements from a non-generative model (~400ms, ~$0.00002
17 lines (16 loc) • 859 B
TypeScript
import type { ProviderModelManifest } from "../../types/index.js";
/**
* Cloudflare Clef on Workers AI — the `decide` inference type, not text
* generation, and not the Workers AI text models of the `cloudflare` provider.
*
* `contextWindow` is the figure Cloudflare documents (65,536 tokens). The
* Workers AI endpoint ignores state text past about 2,048 tokens without an
* error (hosted service or model: unknown), so NeuroLink enforces the limit on
* the descriptor's `decisionLimits`, not this. `vision` describes `generate()`
* input, which this provider does not serve; its image input is
* `DecisionRequest.images`.
*
* `maxOutputTokens` is required by the manifest type but has no honest value
* for a model that emits no text, so a small non-zero figure is used.
*/
export declare const cloudflareClefManifest: ProviderModelManifest;