Re: [php-gtk-webmaster] robots.txt

[email protected] (Christian Weiske) Mon, 17 Jul 2006 19:08:33 +0200
Newsgroups php.gtk.webmaster
Message-ID <[email protected]>
> Should we update our robots.txt file? I see a lot of crawling going on,
> both from search engine crawlers and other stuff.
What do you want to block?

-- 
Regards/MfG,
Christian Weiske
signature.asc (application/pgp-signature, 191 B)
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.2.2 (GNU/Linux)

iD8DBQFEu8QaFMhaCCTq+CMRAqMeAJ9aATvG4JPDidcUPbqTuC4jb9aRNwCdEx5l
N003qSHo3TZMu0SkJzouhQ0=
=+wBI
-----END PGP SIGNATURE-----