forked from mirrors/catstodon
80161f4351
- Exclude static assets - Exclude uploaded files - Exclude alternate versions of the profile page - Exclude media proxy URLs
13 lines
287 B
Text
13 lines
287 B
Text
User-Agent: *
|
|
Disallow: /users/*/followers
|
|
Disallow: /users/*/following
|
|
Disallow: /@*/media
|
|
Disallow: /@*/with_replies
|
|
Disallow: /@*/tagged/*
|
|
Disallow: /media_proxy/*
|
|
Disallow: /emoji/*
|
|
Disallow: /packs/*
|
|
Disallow: /sounds/*
|
|
Disallow: /system/*
|
|
Disallow: /avatars/*
|
|
Disallow: /headers/*
|