A list of common crawler agents used on Internet..
github.com/Kikobeats/top-crawler-agents
Kikobeats/top-crawler-agents