disallow GPTBot/Openai from crawling website

This commit is contained in:
2024-07-30 14:03:32 +02:00
parent a101179022
commit cbd4c0d286

2
static/robots.txt Normal file
View File

@@ -0,0 +1,2 @@
User-agent: GPTBot
Disallow: /