A light weight JS library to check if a user agent is a web crawler.
github.com/pureartisan/is-web-crawler
pureartisan/is-web-crawler