Indexing 2 domains

[email protected] Tue, 21 Nov 2006 12:27:08 -0500
Newsgroups gmane.comp.web.htdig.general
Message-ID <[email protected]>
Hi,

Thanks for your replies.  Here is the htdig.conf settings I've used to
 try to index 2 domains:

database_dir:           /home/ercarlso/opt/htdig-3.1.5/db
database_base:      ${database_dir}/db2

# URLS below contains an html list of all the HTML files under
files2index directory
start_url:              http://www.mydomain1.com/files2index/full_list.html
                            http://www.mydomain2.net/files2index/full_list.html

limit_urls_to:          mydomain1.com/files2index
                               mydomain2.net/files2index

exclude_urls:           /cgi-bin/ .cgi

bad_extensions:         .wav .gz .z .ico .sit .au .zip .tar .hqx .exe
.com .gif \
               .jpg .jpeg .aiff .class .map .ram .tgz .bin .rpm .mpg .mov .avi

maintainer:             [email protected]
max_head_length:        10000
max_doc_size:           200000
no_excerpt_show_top:    true
search_algorithm:       exact:1 synonyms:0.5 endings:0.1
# left out remaining settings for graphics...

With these settings, I get all of "mydomain1.com" indexed, but nothing
from "mydomain2.com" indexed after running "rundig -v"

I was able to index one domain OR the other domain using the method
Jennifer described (two different htdig.conf files), but did not take
the next step to merge the 2 databases.  I'd like to try the simple
method first.

Thanks!
EC

-------------------------------------------------------------------------
Take Surveys. Earn Cash. Influence the Future of IT
Join SourceForge.net's Techsay panel and you'll get the chance to share your
opinions on IT & business topics through brief surveys - and earn cash
http://www.techsay.com/default.php?page=join.php&p=sourceforge&CID=DEVDEV
_______________________________________________
ht://Dig general mailing list: <[email protected]>
ht://Dig FAQ: http://htdig.sourceforge.net/FAQ.html
List information (subscribe/unsubscribe, etc.)
https://lists.sourceforge.net/lists/listinfo/htdig-general