Now we use people.freebsd.org for hosting people public_html directories,

so having these declaration in main robots.txt is not useful anymore.
This commit is contained in:
Alexey Zelkin 2004-04-04 16:45:02 +00:00
parent 2fd82dafc3
commit ffb99ed588
Notes: svn2git 2020-12-08 03:00:23 +00:00
svn path=/www/; revision=20490

View file

@ -1,5 +1,4 @@
User-agent: *
Disallow: /cgi/
Disallow: /~wosch/data
Disallow: /statistic