RE: New Spider

Adrenolin <[email protected]> 4 Aug 2003 07:29:26 -0000
Newsgroups gmane.comp.web.oscommerce.tips
Message-ID <518e7be4ee81ba1aeea2dd391c97e720@osCommerce-Forums>
This message was sent from: Tips and Tricks
http://forums.oscommerce.com/viewtopic.php?p=207142#207142
----------------------------------------------------------------

Hey Bert,

[quote="burt"]Do not use the longer version - waste of time.  

It will simply serve to make your site slower for very little gain in terms of Search Engine Spider SID being killed.[/quote]

I currently still run osC 2.2 MS1 and have Spider Killer for MS1 (VS1.2) installed. My spider_configure.php currently has about 350 spiders listed. I try to ensure that the SIDs are removed from as many known spiders as I can.  I look at this as being a security and privacy issue. The more filtered the better. Am I missing something? Does filtering 350 spiders really take any more time than 30 or 40 spiders?

Could you (or anyone else) kindly explain this and clearup my security/privacy concerns?

Thanks!