os/doc
3
0
Fork 0
Code Issues Pull requests Projects Releases Wiki Activity

Remove a stray blank line from robots.txt.

Browse source 
Add a commented Crawl-delay of 10 seconds, which might be useful
after the commit that is to follow.
This commit is contained in:
Glen Barber 2013-10-04 18:55:55 +00:00
parent 9879ea4ea3
commit 449060a3f2
Notes: svn2git 2020-12-08 03:00:23 +00:00 
svn path=/head/; revision=42830
1 changed files with 1 additions and 1 deletions

2
en_US.ISO8859-1/htdocs/robots.txt
View file

@ -1,7 +1,7 @@
# $FreeBSD$
User-agent: *
#Crawl-delay: 10
Disallow: /cgi/
Disallow: /statistic
Disallow: /sites/downloads.sourceforge.net/