UNPKG

bot-marvin

Version:

Highly scalable crawler with best features.

github.com/tilakpatidar/bot-marvin

tilakpatidar/bot-marvin

10 folders, 9 files

	Filename	Content Type	Size
	config/	–	3.53 kB
	db/	–	20.2 kB
	lib/	–	228 kB
	log/	–	15 B
	man/	–	2.47 kB
	parsers/	–	9.38 kB
	pdf-store/	–	15 B
	scripts/	–	26.8 kB
	server/	–	19.6 MB
	tests/	–	17.2 kB
	.npmignore	text/plain	119 B
	README.md	text/markdown	3.88 kB
	index.js	text/javascript	22.5 kB
	killer.sh	application/octet-stream	238 B
	killport.sh	application/octet-stream	100 B
	package.json	application/json	1.51 kB
	setup_crawler.sh	application/octet-stream	393 B
	spawn.js	text/javascript	34.1 kB
	tika.js	text/javascript	22.6 kB

About

github.com/tilakpatidar/bot-marvin

tilakpatidar/bot-marvin

Releases

9 years ago