crawler-user-agents/MANIFEST.in

This repository contains a list of of HTTP user-agents used by robots, crawlers, and spiders as in single JSON file.

include *.json