UNPKG

inference-server

Version:

Libraries and server to build AI applications. Adapters to various native bindings allowing local inference. Integrate it with your application, or use as a microservice.

5 lines (4 loc) 270 B
import { CompletionFinishReason } from '../../types/index.js'; import OpenAI from 'openai'; export declare const finishReasonMap: Record<CompletionFinishReason, OpenAI.ChatCompletion.Choice['finish_reason']>; export declare const messageRoleMap: Record<string, string>;