UNPKG

microfrontier

Version:

A web crawler frontier implementation in TypeScript backed by Redis. MicroFrontier is a scalable and distributed frontier implemented through Redis Queues.

5 lines (4 loc) 212 B
import { URLFrontier } from "./URLFrontier"; import { FrontendWorker } from "./FrontendWorker"; import { URLFrontierConfig } from "./URLFrontierConfig"; export { URLFrontier, FrontendWorker, URLFrontierConfig };