os/doc
3
0
Fork 0
Code Issues Pull requests Projects Releases Wiki Activity

Now we use people.freebsd.org for hosting people public_html directories,

Browse source 
so having these declaration in main robots.txt is not useful anymore.
This commit is contained in:
Alexey Zelkin 2004-04-04 16:45:02 +00:00
parent 2fd82dafc3
commit ffb99ed588
Notes: svn2git 2020-12-08 03:00:23 +00:00 
svn path=/www/; revision=20490
1 changed files with 0 additions and 1 deletions

1
en/robots.txt
View file

@ -1,5 +1,4 @@
User-agent: * User-agent: *
Disallow: /cgi/ Disallow: /cgi/
Disallow: /~wosch/data
Disallow: /statistic Disallow: /statistic