UNPKG

inference-server

Version:

Libraries and server to build AI applications. Adapters to various native bindings allowing local inference. Integrate it with your application, or use as a microservice.

github.com/iimez/inference-server

iimez/inference-server

4 lines (3 loc) • 274 B
1
2
3
4
import type { IncomingMessage, ServerResponse } from 'node:http'; import type { InferenceServer } from '../../../server.js'; export declare function createChatCompletionHandler(inferenceServer: InferenceServer): (req: IncomingMessage, res: ServerResponse) => Promise<void>;