Re: lftp hangs on certain sites...

Something else...

wget currently has a -i switch that enables you to feed it with a list
(from a file, one per line) of URLs that you wish to download to the
current directory.  Just wondering if this has ever been considered as a
feature request for a future version, perhaps as a mirror -i filename
style mode where you could specify the exact filenames you want downloaded
and mirrored, but with the flexibility to be able to delete everything
else in the current directory unless excluded with -x.

Perhaps something like this:

in the file 'test' we'd have:

http://sourceforge.blah/project/whatsit-1.tgz
http://sourceforge.blah/project/whatsit-1.01.tgz
http://sourceforge.blah/project/bling-1.02.tgz

The local directory might contain:

whatsit-0.9.tgz
whatsit-1.tgz
whatsit-README.txt

The command we'd run is:

cd /path/to/whatsitproject/
lftp -e "mirror -i test -x whatsit-README.txt && quit"

lftp would download whatsit-1.01.tgz and bling-1.02.tgz then delete
whatsit-0.9.tgz but leave whatsit-README.txt in place because it matches
an -x regex.

Given the rubbish sourceforge has gotten up to with their advertising
these days, the only way to mirror their stuff is to pay for access,
download the file listing for a project after logging in, then feed the
thing to wget and pray that it works.  For the most part it does, but it's
hardly mirroring by any stretch of the imagination.

Any thoughts?

Grant