Trouble running rundig on HTDIG-3.2.0b6 version

"Junie Ablay" <[email protected]>
Newsgroups gmane.comp.web.htdig.general
Message-ID <89B36D5AAE35FE4FBA893ADEEBC40FCA0268B00D@MEMEXCH07V.corp.ds.fedex.com>
Hi,
 
My systems are RH7 with htdig-3.2.0b6 installed.    I'm trying to get
htdig to index  the site running on these servers.  The URL i'm trying
to index is a virtual IP that goes to 2 servers. What this means is that
if I type in this URL, it will go to one of the server with less traffic
on it.  I'm trying to build the dbase in just one of the servers. The
ports 80 and 443 are open.    
 
This is the alarm I get.  I tried to locate the robots.txt and that file
is only available on
/opt/fedex/htdig/htdig-3.2.0b6/test/htdocs/robots.txt not on the
Document Root. If I type in the URL
https://dsscos.prod.fedex.com/robots.txt, it says page cannot be found.

 
httpd is running and and if I go to the site
https://dsscos.prod.fedex.com/, I can see data which means this is a
valid URL.
 
+++
[root@cosweb01 bin]# ./rundig -vvv
ht://dig Start Time: Tue Apr  4 10:32:47 2006
        1:1:https://dsscos.prod.fedex.com/
New server: dsscos.prod.fedex.com, 443
 - Persistent connections: enabled
 - HEAD before GET: enabled
 - Timeout: 30
 - Connection space: 0
 - Max Documents: -1
 - TCP retries: 1
 - TCP wait time: 5
 - Accept-Language:
Trying to retrieve robots.txt file
Making HTTP request on https://dsscos.prod.fedex.com/robots.txt
Unable to establish the connection with host: dsscos.prod.fedex.com
(port 443)
Request time: 35 secs
Unable to establish the connection with host: dsscos.prod.fedex.com
(port 443)
Request time: 35 secs
.Unable to establish the connection with host: dsscos.prod.fedex.com
(port 443)
Request time: 35 secs
. pushed
pick: dsscos.prod.fedex.com, # servers = 1
> dsscos.prod.fedex.com with a traditional HTTP connection
ht://dig End Time: Tue Apr  4 10:34:32 2006
htpurge: Database is empty!
 
Preamble text:
+++++
 
Just to simplify the process, I just followed the procedure:
The standard GNU installation process works for ht://Dig.
./configure --prefix=/usr/local
make
make install
vi /usr/local/conf/htdig.conf
/usr/local/bin/rundig
(The final three commands must be issued as root.) 

If I changed the "start_url" into a non-SSL site, rundig runs well.
 
Any help would be greatly appreciated.
 
Junie Ablay III
lmpx.com only provides a reader for public news (NNTP) servers. It is not affiliated with the servers or forums shown here and is not responsible for the content of articles, which is written by their respective authors.