mongoku

Version:

[![CI](https://github.com/huggingface/Mongoku/actions/workflows/ci.yml/badge.svg)](https://github.com/huggingface/Mongoku/actions/workflows/ci.yml)

4 lines (3 loc) • 63 B

Plain Text

# allow crawling everything by default User-agent: * Disallow: