bot-marvin

Version:

Highly scalable crawler with best features.

6 lines (5 loc) • 39 B

Plain Text

*.pdf
*.docx
webpages
*.sh
!.gitignore