mirror of
https://github.com/zedeus/nitter.git
synced 2024-06-10 17:19:21 +00:00
c543a1df8c
Prevents instances from being rate limited due to being senselessly crawled by search engines. Since there is no reason to index Nitter instances, simply block all robots. Notably, this does *not* affect link previews (e.g. in various chat software).
3 lines
26 B
Plaintext
3 lines
26 B
Plaintext
User-agent: *
|
|
Disallow: /
|