Anonymous
09/24/2024 (Tue) 14:49
No.
19573
del
>>19548
Mayby add block for ai bots also.
https://github.com/ai-robots-txt/ai.robots.txt
This is an open list of web crawlers associated with AI companies and the training of LLMs to block.