PrivateBin/robots.txt

# "A robots.txt a day keeps the robots away."
# (for performance and privacy reasons)
#
# Note: To be effective this robots.txt must be put into the root of your server
# directory.

User-agent: *
Disallow: /

# If you don't want this instance to be listed on https://privatebin.info/directory/
# uncomment the following lines:
#User-agent: PrivateBinDirectoryBot
#Disallow: /
Some rewording 2016-07-19 13:05:07 +02:00			`# "A robots.txt a day keeps the robots away."`
			`# (for performance and privacy reasons)`
			`#`
			`# Note: To be effective this robots.txt must be put into the root of your server`
			`# directory.`

For server-load and privacy reasons, disallow robots. 2012-08-02 17:23:04 +02:00			`User-agent: *`
Revert order change According to Wikipedia this is indeed right.. https://en.wikipedia.org/wiki/Robots_exclusion_standard#Allow_directive Then there are only many wrong examples out there. 2016-07-03 13:09:47 +02:00			`Disallow: /`
adding an example to opt-out of the privatebin directory 2020-04-08 05:35:38 +02:00
			`# If you don't want this instance to be listed on https://privatebin.info/directory/`
			`# uncomment the following lines:`
			`#User-agent: PrivateBinDirectoryBot`
			`#Disallow: /`