UNPKG

crawler

Version:

Crawler is a ready-to-use web spider that works with proxies, asynchrony, rate limit, configurable request pools, jQuery, and HTTP/2 support.

github.com/bda-research/node-crawler

bda-research/node-crawler

3 folders, 16 files

	Filename	Content Type	Size
	../
	lib/	–	18.5 kB
	rateLimiter/	–	17.6 kB
	types/	–	7.45 kB
	crawler.d.ts	text/typescript	2.43 kB
	crawler.d.ts.map	application/json	901 B
	crawler.js	text/javascript	13 kB
	crawler.js.map	application/json	10.5 kB
	index.d.ts	text/typescript	95 B
	index.d.ts.map	application/json	154 B
	index.js	text/javascript	93 B
	index.js.map	application/json	152 B
	logger.d.ts	text/typescript	723 B
	logger.d.ts.map	application/json	160 B
	logger.js	text/javascript	843 B
	logger.js.map	application/json	834 B
	options.d.ts	text/typescript	493 B
	options.d.ts.map	application/json	428 B
	options.js	text/javascript	4.42 kB
	options.js.map	application/json	4.32 kB