truncated search results assistance

"Jignesh Patel" <[email protected]>
Newsgroups gmane.comp.web.htdig.general
Message-ID <[email protected]>
Hello,

Has anyone experienced incomplete search results when running htdig on Red Hat 7.2 Enterprise Linux?  I'm receiving incomplete or truncated search results when calling the htsearch CGI from the *command line* or a browser.  The file size of the search results are usually a little larger than 8k (8,165bytes, 8,174bytes, or 8,219bytes) when executing from the command line (e.g. */cgi-bin/htsearch) or a browser, although there have been times when the results have been as large as 12k (12,261bytes).  This behavior is manifested in multiple versions of htdig as well.  htdig version 3.2.0b4-20030406 is currently installed and experiencing errors, this is after seeing identical incomplete search errors with the newer htdig version 3.2.0b6-20041114.  The htdig.conf file uses all of the default values, save for the following exceptions:

start_url:            http://refocus.hap.org/bam/ 
maintainer:           [email protected] 
template_map: Long long /appl/htdig/share/htdig/long.html
template_name: long

For testing purposes, the default long templates are used without additional modifications.  The command used to index the site is "/appl/htdig/bin/rundig -vvv -a", although I've also used the explicit permutation as well of "/appl/htdig/bin/rundig -c /appl/htdig/conf/htdig.conf -vvv -a".  I'm attaching the results of a typical search, note that only items 1-8 are displayed.  In addition to an incomplete item 8, there is also no item 9, 10, or the related navigation buttons (button1.gif through button3.gif and buttonr.gif) based on 33 matches.

We run htdig on our Solaris web servers with identical configurations without any issues.  Rebuilding the databases from scratch using the "/appl/htdig/bin/rundig -vvv -a" command is successful and does not result in any errors.  In addition, there are no system or web server level errors when performing a search with the htsearch CGI.  

Although building the package is successful, I'm suspecting that there may be version and dependency issues related with the RPM's needed to build htdig.  Here is a list of the RPM's required to build the package:

glibc-common-2.2.4-31.7
glibc-2.2.4-31.7
kernel-headers-2.4.9-e.12
glibc-devel-2.2.4-31.7
cpp-2.96-116.7.2
binutils-2.11.90.0.19-4
gcc-2.96-116.7.2
zlib-1.1.3-25.7
zlib-devel-1.1.3-3

Also, here is the typical command that was run on both versions of the htdig on the Red Hat 7.2 Enterprise Linux box (this is also the identical command used within our Solaris servers):

CXXFLAGS=-Wno-deprecated CPPFLAGS=-Wno-deprecated ./configure --with-zlib=/usr/bin --disable-shared --prefix=/appl/htdig --with-cgi-bin-dir=/appl/www/focus/cgi-bin --with-image-dir=/appl/www/focus/common/images --with-search-dir=/appl/www/focus --with-image-url-prefix=/common/images

Full installation details are listed in the attached log file.  

Could you take a look at the following screen shots as well as installation details and provide some direction?  Any insight is most welcome.

Thanks,
htdig_install_1Jul2005.log (text/plain, 193.4 KB) - not displayed
htdig_search_troubleshooting_5Jul2005.doc (application/msword, 91 KB) - not displayed
lmpx.com only provides a reader for public news (NNTP) servers. It is not affiliated with the servers or forums shown here and is not responsible for the content of articles, which is written by their respective authors.