doc/en/robots.txt
Alexey Zelkin ffb99ed588 Now we use people.freebsd.org for hosting people public_html directories,
so having these declaration in main robots.txt is not useful anymore.
2004-04-04 16:45:02 +00:00

4 lines
52 B
Text

User-agent: *
Disallow: /cgi/
Disallow: /statistic