UNPKG

ai

Version:

AI SDK by Vercel - build apps like ChatGPT, Claude, Gemini, and more with a single interface for any model using the Vercel AI Gateway or go direct to OpenAI, Anthropic, Google, or any other model provider.

34 lines (23 loc) 912 B
--- title: Azure OpenAI Slow to Stream description: Learn to troubleshoot Azure OpenAI slow to stream issues. --- # Azure OpenAI Slow To Stream ## Issue When using OpenAI hosted on Azure, streaming is slow and in big chunks. ## Cause This is a Microsoft Azure issue. Some users have reported the following solutions: - **Update Content Filtering Settings**: Inside [Azure AI Studio](https://ai.azure.com/), within "Shared resources" > "Content filters", create a new content filter and set the "Streaming mode (Preview)" under "Output filter" from "Default" to "Asynchronous Filter". ## Solution You can use the [`smoothStream` transformation](/docs/ai-sdk-core/generating-text#smoothing-streams) to stream each word individually. ```tsx highlight="6" import { smoothStream, streamText } from 'ai'; const result = streamText({ model, prompt, experimental_transform: smoothStream(), }); ```