diff options
| author | Aki <please@ignore.pl> | 2023-12-27 01:42:38 +0100 |
|---|---|---|
| committer | Aki <please@ignore.pl> | 2023-12-27 01:42:38 +0100 |
| commit | 946b5505e8ec5111cab0676f05ade282097da726 (patch) | |
| tree | f270a512970ac40979ef0ce1768635a13757ded1 | |
| parent | b5028afd6db466ac6ab8528a6f9a5fcd6d1fdb8a (diff) | |
| download | ignore.pl-946b5505e8ec5111cab0676f05ade282097da726.zip ignore.pl-946b5505e8ec5111cab0676f05ade282097da726.tar.gz ignore.pl-946b5505e8ec5111cab0676f05ade282097da726.tar.bz2 | |
Naively disallow access for AI scrappers
This is more of a symbolic gesture than anything else honestly
| -rw-r--r-- | robots.txt | 4 |
1 files changed, 4 insertions, 0 deletions
@@ -1,2 +1,6 @@ +User-agent: GPTBot +User-agent: Google-Extended +Disallow: / + User-agent: * Allow: / |