Re: [php-gtk-webmaster] robots.txt

[email protected] (Andrei Zmievski) Mon, 17 Jul 2006 10:31:00 -0700

Newsgroups	php.gtk.webmaster
Message-ID	<[email protected]>

Not sure. That's why I was asking.

-A

On Jul 17, 2006, at 10:08 AM, Christian Weiske wrote:

>> Should we update our robots.txt file? I see a lot of crawling going 
>> on,
>> both from search engine crawlers and other stuff.
> What do you want to block?
>
> -- 
> Regards/MfG,
> Christian Weiske
>