sails-generate-frontend/templates/assets/robots.txt

Default generator for frontend code files in new Sails projects. Creates the default contents of the `assets/` folder when you run `sails new` on the command-line. Also creates a subset of the boilerplate Grunt task files (in `tasks/`); specifically, the

# The robots.txt file is used to control how search engines index your live URLs.
# See http://sailsjs.org/documentation/anatomy/my-app/assets/robots-txt for more information.



# To prevent search engines from seeing the site altogether, uncomment the next two lines:
# User-Agent: *
# Disallow: /