Re: do not index but follow links

Riccardo Cohen <[email protected]> Wed, 19 Dec 2007 14:10:35 +0100
Newsgroups gmane.comp.web.htdig.general
Organization Articque
Message-ID <[email protected]>
Thanks for your answer,
Actually I cannot add these urls in the config, the products list is =

changed regularly with the CMS

I'll try the second idea, I can surely add the dynamic list in only one =

page.

Thanks a lot.

[email protected] wrote:
> There are at least a couple of ways around this.
> =

> 1. Add the URLs of these sections into your START_URL definition (http://=
www.htdig.org/attrs.html#start_url)
> =

> 2. Add (possibly hidden) links to these sections, outside of the menu tha=
t you described, such as on your home page. (If the links are 'empty' then =
it won't affect your index too much.)
> =

> Hope that helps,
> Mike
>  =

> =

>> -----Original Message-----
>> From: [email protected] =

>> [mailto:[email protected]] On Behalf =

>> Of Riccardo Cohen
>> Sent: Tuesday, December 18, 2007 11:57 PM
>> To: [email protected]
>> Subject: [htdig] do not index but follow links
>>
>> Hi
>> In my pages I have a menu : "product1 product2 product3"
>> These menu items lead to pages describing each product.
>>
>> Of course, if htdig indexes the pages normally, then searching =

>> for "product1" gives all product pages because they all have =

>> this menu in it..., while the only interesting page is product1
>>
>> So I tried to use <!--htdig_noindex-->, but then the menu is =

>> not scanned at all, and the products pages are not pushed and =

>> then not indexed at all.
>>
>> Is there any way to follow links in a section without indexing =

>> the words in this section ?
>>
>> I've searched a lot the docs and mailing list but could not =

>> find any clue.
>>
>> Thanks
>>
>> --
>> Tr=E8s cordialement,
>>
>> Riccardo Cohen
>> -------------------------------------------
>> Articque
>> http://www.articque.com
>> 149 av G=E9n=E9ral de Gaulle
>> 37230 Fondettes - France
>> tel : 02-47-49-90-49
>> fax : 02-47-49-91-49
>>
>>
>> ---------------------------------------------------------------
>> ----------
>> SF.Net email is sponsored by:
>> Check out the new SourceForge.net Marketplace.
>> It's the best place to buy or sell services for just about =

>> anything Open Source.
>> http://ad.doubleclick.net/clk;164216239;13503038;w?http://sf.ne
> t/marketplace
>> _______________________________________________
>> ht://Dig general mailing list: <[email protected]>
>> ht://Dig FAQ: http://htdig.sourceforge.net/FAQ.html
>> List information (subscribe/unsubscribe, etc.) =

>> https://lists.sourceforge.net/lists/listinfo/htdig-general
>>
> =


-- =

Tr=E8s cordialement,

Riccardo Cohen
-------------------------------------------
Articque
http://www.articque.com
149 av G=E9n=E9ral de Gaulle
37230 Fondettes - France
tel : 02-47-49-90-49
fax : 02-47-49-91-49

-------------------------------------------------------------------------
SF.Net email is sponsored by:
Check out the new SourceForge.net Marketplace.
It's the best place to buy or sell services
for just about anything Open Source.
http://ad.doubleclick.net/clk;164216239;13503038;w?http://sf.net/marketplace
_______________________________________________
ht://Dig general mailing list: <[email protected]>
ht://Dig FAQ: http://htdig.sourceforge.net/FAQ.html
List information (subscribe/unsubscribe, etc.)
https://lists.sourceforge.net/lists/listinfo/htdig-general