Indexing 2 domains
[email protected] Tue, 21 Nov 2006 12:27:08 -0500
| Newsgroups | gmane.comp.web.htdig.general |
|---|---|
| Message-ID | <[email protected]> |
Hi,
Thanks for your replies. Here is the htdig.conf settings I've used to
try to index 2 domains:
database_dir: /home/ercarlso/opt/htdig-3.1.5/db
database_base: ${database_dir}/db2
# URLS below contains an html list of all the HTML files under
files2index directory
start_url: http://www.mydomain1.com/files2index/full_list.html
http://www.mydomain2.net/files2index/full_list.html
limit_urls_to: mydomain1.com/files2index
mydomain2.net/files2index
exclude_urls: /cgi-bin/ .cgi
bad_extensions: .wav .gz .z .ico .sit .au .zip .tar .hqx .exe
.com .gif \
.jpg .jpeg .aiff .class .map .ram .tgz .bin .rpm .mpg .mov .avi
maintainer: [email protected]
max_head_length: 10000
max_doc_size: 200000
no_excerpt_show_top: true
search_algorithm: exact:1 synonyms:0.5 endings:0.1
# left out remaining settings for graphics...
With these settings, I get all of "mydomain1.com" indexed, but nothing
from "mydomain2.com" indexed after running "rundig -v"
I was able to index one domain OR the other domain using the method
Jennifer described (two different htdig.conf files), but did not take
the next step to merge the 2 databases. I'd like to try the simple
method first.
Thanks!
EC
-------------------------------------------------------------------------
Take Surveys. Earn Cash. Influence the Future of IT
Join SourceForge.net's Techsay panel and you'll get the chance to share your
opinions on IT & business topics through brief surveys - and earn cash
http://www.techsay.com/default.php?page=join.php&p=sourceforge&CID=DEVDEV
_______________________________________________
ht://Dig general mailing list: <[email protected]>
ht://Dig FAQ: http://htdig.sourceforge.net/FAQ.html
List information (subscribe/unsubscribe, etc.)
https://lists.sourceforge.net/lists/listinfo/htdig-general