For the past couple of days I've started reviewing whois.dollardns.net weblogs. The whois tool is not to be crawled as specified in the robots.txt and I most certainly do not allow programs to query that tool automatically for any reason. But I've banned a webcrawler that ignored robots.txt and a DSL user who put quite a bit of load on my tool searching for all combinations of short domains and various dictionary word permutations.
DollarDNS keeps all weblogs - all. In the 2+ years DollarDNS has been in operation, not a single log has been deleted. It is a trivial thing to use 'grep' to search all 2 years worth of logs for patterns. Despite the fact that I don't review the logs very often anymore, doesn't mean abuse will go unnoticed forever. Dave Clark [email] [irc chat] DollarDNS Services
|
Today I've banned anonymouse.org cause it was used for some automated queries for the past couple of months. It wasn't real heavy traffic so I didn't notice it until now when I investigated other IPs that were turning up in my error logs.
IMHO, anonymizer services are evil. They are slower to use when browsing the web and they make webmasters suspicious that you are doing something wrong. Don't skulk about hiding yourself or you will be called a criminal (even when you're doing it for very legitimate reasons). Personally I don't mind anonymizers browsing my website, but from now on you're not allowed to use the whois tool that way. Dave Clark [email] [irc chat] DollarDNS Services
|