github.com/walf443/mgr@v0.0.0-20150203144449-6f7a3a548462/cli/railssample/public/robots.txt (about)

     1  # See http://www.robotstxt.org/robotstxt.html for documentation on how to use the robots.txt file
     2  #
     3  # To ban all spiders from the entire site uncomment the next two lines:
     4  # User-agent: *
     5  # Disallow: /