disallow GPTBot/Openai from crawling website
This commit is contained in:
		
							
								
								
									
										2
									
								
								static/robots.txt
									
									
									
									
									
										Normal file
									
								
							
							
						
						
									
										2
									
								
								static/robots.txt
									
									
									
									
									
										Normal file
									
								
							@@ -0,0 +1,2 @@
 | 
				
			|||||||
 | 
					User-agent: GPTBot
 | 
				
			||||||
 | 
					Disallow: /
 | 
				
			||||||
		Reference in New Issue
	
	Block a user