Disallow /mail/archive/, 80% of the traffic are from dumb robots.

This commit is contained in:
Wolfram Schneider 1999-01-23 12:40:46 +00:00
parent 372b9d5070
commit 7621200d90
Notes: svn2git 2020-12-08 03:00:23 +00:00
svn path=/www/; revision=4103

View file

@ -7,3 +7,4 @@ Disallow: /~wosch/test/
Disallow: /statistic
Disallow: /stat
Disallow: /gifs/
Disallow: /mail/archive/