github.com/MangoDowner/go-gm@v0.0.0-20180818020936-8baa2bd4408c/robots.txt (about) 1 User-agent: * 2 Disallow: /