UNPKG

@juspay/neurolink

Version:

The pipe layer of an AI nervous system: one interface connecting provider neurons to your application, across three inference types — generate, stream and decide. `decide` returns typed, calibrated judgements from a non-generative model (~400ms, ~$0.00002

126 lines (125 loc) • 6.28 kB
{ "$schema": "./provider-catalog.schema.json", "id": "cloudflare", "displayName": "Cloudflare Workers AI", "aliases": ["workers-ai", "cf-ai"], "tier": 2, "wire": { "baseURLTemplate": "https://api.cloudflare.com/client/v4/accounts/{accountId}/ai/v1", "extraCredentials": ["accountId"], "missingCredentialMessage": "CLOUDFLARE_ACCOUNT_ID is required (or pass credentials.cloudflare.accountId). Get the account id from https://dash.cloudflare.com/" }, "models": { "default": "@cf/meta/llama-3.3-70b-instruct-fp8-fast", "fallbackModelName": "@cf/meta/llama-3.1-8b-instruct-fast", "fallbacks": [ "@cf/meta/llama-3.3-70b-instruct-fp8-fast", "@cf/meta/llama-3.1-70b-instruct", "@cf/meta/llama-3.1-8b-instruct-fast", "@cf/google/gemma-2b-it-lora" ], "defaultContextWindow": 8192, "defaultMaxOutputTokens": 4096, "catalog": { "@cf/meta/llama-3.3-70b-instruct-fp8-fast": { "enumMember": "LLAMA_3_3_70B_FAST", "contextWindow": 24000, "vision": false, "status": "production", "description": "Recommended - Llama 3.3 70B Instruct (FP8 fast)" }, "@cf/meta/llama-3.1-70b-instruct": { "enumMember": "LLAMA_3_1_70B_INSTRUCT", "contextWindow": 24000, "vision": false, "status": "production", "description": "Llama 3.1 70B Instruct" }, "@cf/meta/llama-3.1-8b-instruct-fast": { "enumMember": "LLAMA_3_1_8B_FAST", "contextWindow": 24000, "vision": false, "status": "production", "description": "Llama 3.1 8B Instruct (fast)" }, "@cf/meta/llama-3.2-11b-vision-instruct": { "enumMember": "LLAMA_3_2_11B_VISION", "contextWindow": 24000, "vision": false, "status": "production", "description": "Llama 3.2 11B Vision Instruct — Meta Community License accepted on the account 2026-09-02, but Cloudflare's OpenAI-compatible endpoint accepts no image input for it: an image content part is rejected (400) and a top-level image is ignored ('There is no image'). The model reads images only through the native /ai/run prompt+image shape, which this OpenAI-compatible provider does not speak, so vision stays false here" }, "@cf/mistral/mistral-7b-instruct-v0.2": { "enumMember": "MISTRAL_7B_INSTRUCT_V0_2", "contextWindow": 32768, "vision": false, "status": "retired", "description": "Retired 2026-08 — Cloudflare answers 'No such model'" }, "@cf/qwen/qwen1.5-14b-chat-awq": { "enumMember": "QWEN_1P5_14B_CHAT_AWQ", "contextWindow": 7500, "vision": false, "status": "retired", "description": "Retired 2026-08 — Cloudflare reports it was deprecated on 2025-10-01" }, "@cf/google/gemma-2b-it-lora": { "enumMember": "GEMMA_2B_IT_LORA", "contextWindow": 4096, "vision": false, "status": "production", "description": "Gemma 2B IT (LoRA)" } }, "topModels": [ "@cf/meta/llama-3.3-70b-instruct-fp8-fast", "@cf/meta/llama-3.1-70b-instruct", "@cf/meta/llama-3.1-8b-instruct-fast", "@cf/google/gemma-2b-it-lora" ] }, "capabilities": { "text": true, "streaming": true, "tools": true, "toolsWithStreaming": true, "structuredOutput": false, "structuredOutputWithTools": false, "embeddings": false, "thinking": false }, "errorRules": [ { "status": 401, "pattern": "Invalid API key|Authentication", "class": "authentication", "message": "Invalid Cloudflare API key. Use a token with Workers AI Read+Write scope. Get one at https://dash.cloudflare.com/profile/api-tokens" } ], "setup": { "url": "https://dash.cloudflare.com/profile/api-tokens", "apiKeyFormat": null, "billingPolicy": "free-tier", "description": "API token (Workers AI Read+Write scope)", "instructions": [ "1. Visit: https://dash.cloudflare.com/profile/api-tokens", "2. Create a token with 'Workers AI: Read + Write' scope", "3. Set {apiKeyEnvVar} in your .env file", "4. Also set CLOUDFLARE_ACCOUNT_ID (find it in the dashboard URL or under 'Account ID')" ] }, "evidence": { "rosterVerified": { "date": "2026-08-30", "method": "real chat call per id against the live account" }, "liveMatrix": { "date": "2026-09-02", "result": "Live tool round-trip verified on @cf/meta/llama-3.1-8b-instruct-fast, both non-streaming and streaming, once messageContentFormat normalization was applied; before it the follow-up turn was rejected with HTTP 400 (content sent as array/null). Of the three ids that failed, only two are actually gone: mistral-7b-instruct-v0.2 ('No such model') and qwen1.5-14b-chat-awq ('deprecated on 2025-10-01'). llama-3.2-11b-vision-instruct is alive but gated behind a one-time Community License acceptance on the account, so it answers 403 and is left production with vision false rather than retired. Update 2026-09-02: the Community License was accepted on the account; plain chat on llama-3.2-11b-vision-instruct now returns 200 on both endpoints, and the native /ai/run prompt+image call describes a 64x64 test image correctly. The OpenAI-compatible endpoint still cannot carry an image (content-part array → 400, top-level image ignored), so the vision flag remains false for this provider." }, "addedInPR": "https://github.com/juspay/neurolink/pull/1587" }, "quirks": { "messageContentFormat": "string" } }