UNPKG

robots-parse

Version:

A lightweight and simple robots.txt parser in node.

github.com/b4dnewz/robots-parse

b4dnewz/robots-parse

3 files

	Filename	Content Type	Size
	../
	index.js	text/javascript	103 B
	parser.js	text/javascript	2.27 kB
	scanner.js	text/javascript	1.01 kB