Re: Correct way to block web bots and other unwanted traffic?

On Tue, Dec 05, 2006 at 07:16:20AM -0700, Andy Ruhl wrote:

> So my question is, what's the right way to block these guys?

insert this into a robots.txt file :

User-agent: *
Disallow:/

upload to the root folder of your web server.

most will comply but some wont. you can either insert rules
into your firewall to only allow your friends (if they have
static ip for example) or require authentification.

-- 
unzip ; strip ; touch ; grep ; find ; finger ; mount ; fsck ; more ;
yes ; fsck ; umount ; sleep