This comic follows on from the Previous comic which will almost certainly provide context.
You might not wanna be famous, but when you're level 10, every organization within a mile is watching what you're doing.
this post was submitted on 01 Sep 2024
320 points (97.3% liked)
RPGMemes
15742 readers
689 users here now
Humor, jokes, memes about TTRPGs
founded 2 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
Here's a short little "meanwhile" comic as a bonus, since it's been a while.
Oh, apologies about my personal website. My hosting is done by a friend with a small server, and... well basically every wordpress site in existence is now under constant effective-DDoS by AI bots trying to scrape all the data. They're not subtle about it, and just try to download all the pictures simultaneously. My server is too small to handle that load, so just reboots when that happens (it's usually down for about a minute).
The fact that it's near constantly down is just a product of how often I'm getting these requests.
This won't fix it but it might help.
Make sure you have a robots.txt file with a crawl delay set for all agents once every 30 seconds and that you are disallowing most of the WordPress directories such as WP admin, the media directory, etc.
I would also strongly recommend that you use a caching system if you are not using one. It's a lot more efficient to serve the same image a hundred times to different bots from the ram than loading it off your drive.
Just my personal opinions working in a web hosting environment.
That'll probably help if it's i/o issues.
Yeah, you might need some combination of fail2ban for rude AI and cloudflare caching or something.
Whoever their host is, they already appear to have some type of load balancing based on the four IPS. But I would also agree that a free cloudflare account does wonders for most WordPress users. But that's probably mostly because it filters out a shitload of bots and known bad actors. Just make sure you set up your origin certificates if you use a cloudflare account.
We are already using cloudflare.
Have you also enabled Bot Fight Mode? (There's a setting to "Block AI bots" that seems useful in your situation)
~~I shall mention it to my web admin~~
(Edit): Bot fight mode breaks wordpress' commenting system, which ideally I'd like to preserve.