index
:
ignore.pl
master
ignore.pl blog
Aki
summary
refs
log
tree
commit
diff
log msg
author
committer
range
diff options
context:
1
2
3
4
5
6
7
8
9
10
15
20
25
30
35
40
space:
include
ignore
mode:
unified
ssdiff
stat only
Diffstat
-rw-r--r--
robots.txt
4
1 files changed, 4 insertions, 0 deletions
diff --git a/robots.txt b/robots.txt
index c2a49f4..19df36c 100644
--- a/
robots.txt
+++ b/
robots.txt
@@ -1,2 +1,6 @@
+User-agent: GPTBot
+User-agent: Google-Extended
+Disallow: /
+
User-agent: *
Allow: /