disallow GPTBot/Openai from crawling website

This commit is contained in:
2024-07-30 14:03:32 +02:00
parent 6a93d56818
commit c9f1c5826c
+2
View File
@@ -0,0 +1,2 @@
User-agent: GPTBot
Disallow: /