disallow GPTBot/Openai from crawling website
All checks were successful
CI / update (push) Successful in 1m7s
All checks were successful
CI / update (push) Successful in 1m7s
This commit is contained in:
parent
a1460f5ee3
commit
aeee16078d
2
static/robots.txt
Normal file
2
static/robots.txt
Normal file
@ -0,0 +1,2 @@
|
||||
User-agent: GPTBot
|
||||
Disallow: /
|
Loading…
Reference in New Issue
Block a user