FTP Troubles w/ many servers

Keller <[email protected]> Mon, 09 Feb 2004 15:31:01 -0600
Newsgroups gmane.linux.redhat.rpm.grab
Message-ID <[email protected]>
I know that this list is fairly dormant, but I hope someone will get
this who can help me.  I'm currently trying to index a bunch of rpms
from one server in many directories (in my case, the different
directories in ftp://speakeasy.rpmfind.net/linux/).  If I try to just
recursively index that one directory, I get a timeout from grab.  If I
try to manually input each of the subdirectories (/mandrake, /freshmeat,
etc) of that directory, then grab runs fine for a while, but inevitably
gives me a "cannot connect to rpmfind.speakeasy.net" and then ends the
update.  If I run with debug, I find that it connects to the server fine
many times and then simply can't.  I assume that it's just an anomaly
that occurs once in a while, but since I'm updating so many directories,
occurs once in the many connections that grab makes for my server list. 
In case it helps, here's the command line I'm using ::

grab --update -W -debug

I've also attached my config and servers files, just in case they help. 
Is there any way to force grab to continue even after it can't connect
to a server?  Can I setup perl's ftp to retry a server if it's unable to
connect?  Thanks so much for the help!

Sincerely, 
Keller