UNPKG
robots
Version:
latest (0.10.1)
0.10.1
0.10.0
0.9.5
0.9.4
0.9.3
0.9.2
0.9.1
0.9.0
0.8.0
0.7.2
0.7.1
0.7.0
0.6.0
0.5.1
0.5.0
0.4.0
0.3.3
0.3.2
0.3.1
Parser for robots.txt
github.com/ekalinin/robots.js
ekalinin/robots.js
robots
/
.npmignore
4 lines
(3 loc)
•
25 B
Plain Text
View Raw
1
2
3
4
*.swp
env
/ node_modules/