Another Day, Another Banned Bot

The amount of people doing their own internet crawlers never ceases to amaze me, nor does the utter stupidity of some implementations.

As a nice (and utterly satisfying) follow-up to breakfast, I just banned the nether regions out of IP address, which is running some piece of crap known as rssImagesBot/0.1.

As usual, that particular bot ignored robots.txt (or seemed to) and didn't understand BASE HREF, so it got itself caught in an infinite loop, requesting URLs like blog/blog/blog/... and making my Apache throw a fit (not to mention the waste of otherwise perfectly good bandwidth, since it was constantly making requests, without any sort of pause).

All for the sake of assembling a dumb page with the images it got from crawling.

I don't care how cool it is - it isn't coming back here.

Oh, and have a nice day.