7f15a538c5
the monthly.cgi and updating various pieces of documentation. Notably missing is the French translation. Reviewed by: bcr Approved by: bcr (mentor) Sponsored by: DARPA, AFRL Differential Revision: https://reviews.freebsd.org/D17300
19 lines
452 B
Text
19 lines
452 B
Text
# $FreeBSD$
|
|
|
|
User-agent: *
|
|
#Crawl-delay: 10
|
|
Disallow: /cgi/confirm-code.cgi
|
|
Disallow: /cgi/cvsweb.cgi
|
|
Disallow: /cgi/dosendpr.cgi
|
|
Disallow: /cgi/getmsg.cgi
|
|
Disallow: /cgi/mailindex.cgi
|
|
#Disallow: /cgi/man.cgi
|
|
Disallow: /cgi/mid.cgi
|
|
Disallow: /cgi/mirror.cgi
|
|
Disallow: /cgi/missing_handler.cgi
|
|
Disallow: /cgi/ports.cgi
|
|
Disallow: /cgi/query-pr-summary.cgi
|
|
Disallow: /cgi/query-pr.cgi
|
|
Disallow: /cgi/search.cgi
|
|
Disallow: /cgi/url.cgi
|
|
Disallow: /statistic
|