I had over 500 instances of ClaudeBot hit my site simultaneously and come close to bringing the shared webserver to it's knees, as well as over 50 instances of the Facebook bots. All at once. The robots.txt mods seem to have taken care of most of that, however I've also taken the step of temporarily removing open read access without an active forum account until these bots get under control. Too many times of having significant web server slowdowns and my site will probably be looking for a new home as it shares server space with commercial profit-making customers for the webhost.
Understand from monitoring some other forums that the current iteration of ClaudeBot is supposedly being hosted by Amazon AWS....
Eric
Understand from monitoring some other forums that the current iteration of ClaudeBot is supposedly being hosted by Amazon AWS....
Eric
Statistics: Posted by elc32955 — Sun May 05, 2024 3:57 am