disallow GPTBot/Openai from crawling website
All checks were successful
CI / update (push) Successful in 1m7s
All checks were successful
CI / update (push) Successful in 1m7s
This commit is contained in:
2
static/robots.txt
Normal file
2
static/robots.txt
Normal file
@ -0,0 +1,2 @@
|
||||
User-agent: GPTBot
|
||||
Disallow: /
|
Reference in New Issue
Block a user