Re: [php-gtk-webmaster] robots.txt
[email protected] (Christian Weiske) Mon, 17 Jul 2006 19:08:33 +0200
| Newsgroups | php.gtk.webmaster |
|---|---|
| Message-ID | <[email protected]> |
> Should we update our robots.txt file? I see a lot of crawling going on, > both from search engine crawlers and other stuff. What do you want to block? -- Regards/MfG, Christian Weiske
signature.asc
(application/pgp-signature, 191 B)
-----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.2.2 (GNU/Linux) iD8DBQFEu8QaFMhaCCTq+CMRAqMeAJ9aATvG4JPDidcUPbqTuC4jb9aRNwCdEx5l N003qSHo3TZMu0SkJzouhQ0= =+wBI -----END PGP SIGNATURE-----