There appear to be configuration errors causing an absurd amount of links to be generated.
For now, block access to search engines until the problem is properly resolved. While here, add $FreeBSD$
This commit is contained in:
parent
a34534594e
commit
183eca6912
Notes:
svn2git
2020-12-08 03:00:23 +00:00
svn path=/head/; revision=41802
1 changed files with 4 additions and 0 deletions
|
@ -1,4 +1,8 @@
|
|||
# $FreeBSD$
|
||||
|
||||
User-agent: *
|
||||
|
||||
Disallow: /cgi/
|
||||
Disallow: /statistic
|
||||
Disallow: /publish.html/hu-hu/
|
||||
Disallow: /cgi/
|
||||
|
|
Loading…
Reference in a new issue