Re: [php-gtk-webmaster] robots.txt
[email protected] ("Steph Fox") Mon, 17 Jul 2006 19:02:12 +0200
| Newsgroups | php.gtk.webmaster |
|---|---|
| Message-ID | <03c201c6a9c2$c03f95e0$6602a8c0@foxbox> |
What I know of that stuff could comfortably fit on a pinhead. Anyone? > Should we update our robots.txt file? I see a lot of crawling going on, > both from search engine crawlers and other stuff. > > -Andrei > > -- > PHP-GTK Webmaster Mailing List (http://gtk.php.net/) > To unsubscribe, visit: http://www.php.net/unsub.php >