Re: Crawler problems
Steve Holdoway <[email protected]> Tue, 22 Nov 2011 10:10:11 +1300
| Newsgroups | gmane.org.user-groups.linux.new-zealand.general |
|---|---|
| Organization | Green Gecko Global Ltd. |
| Message-ID | <1321909811.17618.358.camel@steve-desktop> |
On Tue, 2011-11-22 at 10:00 +1300, Mark Foster wrote: > Baidubot went nuts on my image gallery last month - blew out my > bandwidth limits. They're now blocked at the supernet in the webserver > config (returning errors to everything, now). 180.76.5.0/24 occupies 29 > of the top 30 IP's to visit my image gallery this month. Each request is > zero'd-out byte-wize due to the drop, but as I can't firewall the > connections off, they continue to pollute my log files. Good* to know I'm not alone. I firewalled 180.76.5.0/24 and 180.76.6.0/24 to drop Baidu. Cheers, Steve *Well, maybe a new definition of good, but you know what I mean. -- Steve Holdoway BSc(Hons) MNZCS <[email protected]> http://www.greengecko.co.nz MSN: [email protected] Skype: sholdowa _______________________________________________ NZLUG mailing list [email protected] http://www.linux.net.nz/cgi-bin/mailman/listinfo/nzlug