Re: Strange timeout issue...

On Fri, 17 Aug 2012, Cris Rhea wrote:

>
>
> As you suspected, urlgrabber has horrid performance compared to wget.
>
> What's the next step?

Figure out what it is that's taking all the time/timeout in urlgrabber - 
strace is probably going to be your pal there.


>
> PS: Don't want to go off-topic for this list, but why the comments on ftp?

ftp is a pain to firewall for, most of the ftp daemons aren't actively 
maintained anymore, in general it is just pain.

http servers are diverse, good and well-maintained. It is trivial to 
firewall for them and they have much more flexibility than ftp servers do.

In general, I try to discourage folks from using ftp if they have a 
choice.

-sv