RE: New Spider

Adrenolin <[email protected]> 5 Sep 2003 16:07:39 -0000
Newsgroups gmane.comp.web.oscommerce.tips
Message-ID <e6400a411c871cfc1aa2333dafcbaca8@osCommerce-Forums>
This message was sent from: Tips and Tricks
http://forums.oscommerce.com/viewtopic.php?p=224792#224792
----------------------------------------------------------------

[quote="wizardsandwars"]No, it could take some time.

It depends on how many urls the spider harvested with urls befroe you put the user agent in the array.[/quote]

Hey Chris,
How is this? If you add the new spider into your list then when/if it returns the cart sees it as a spider and does not generate sids. Please correct me if this is incorrect.. again :-)

I do understand that if your listed in the search database with sids then yes it could take some time for those to be removed.

Thanks.