Identifying Known Spiders?
"Michael Crawford" <[email protected]>
| Newsgroups | gmane.comp.web.analog.general |
|---|---|
| Message-ID | <[email protected]> |
I'd like to know the success of my efforts to submit a new site to all the search engines; some spiders won't visit a site until it's been online for a while, and some will only visit the home page. I can see some of the spiders in the BROWSERREP and BROWSERSUM, but it's missing some because it's definitely missing Googlebot and Yahoo Slurp. Also the BROWSERREP shows all the browsers used by my human visitors; it will get hard to spot spiders when my traffic picks up. Is there a report specifically for known spiders? Thanks! -- Mike -- Michael David Crawford mdcrawford at gmail dot com Enjoy my art, photography, music and writing at http://www.geometricvisions.com/ --- Free Music Downloads --- +------------------------------------------------------------------------ | TO UNSUBSCRIBE from this list: | http://lists.meer.net/mailman/listinfo/analog-help | | Analog Documentation: http://analog.cx/docs/Readme.html | List archives: http://www.analog.cx/docs/mailing.html#listarchives | Usenet version: news://news.gmane.org/gmane.comp.web.analog.general +------------------------------------------------------------------------