Re: misbehaving HTTP server makes lftp retry forever
Nate Sutton <[email protected]> Thu, 14 Apr 2016 15:15:45 -0500
| Newsgroups | gmane.network.lftp.user |
|---|---|
| Message-ID | <CAMZDCY3mSrjs9c=Mn+KS3_6TKTZfQd4KkfDpMzfan1OQx0oZgQ@mail.gmail.com> |
Ahhhh that makes sense, and that'll work, thanks! On Thu, Apr 14, 2016 at 5:36 AM, Alexander V. Lukyanov <[email protected]> wrote: > On Thu, Apr 14, 2016 at 01:50:35AM -0500, Nate Sutton wrote: > > I tried it and setting it to a low timeout setting (10) made it fail > with a > > timeout, so it does work for the purpose, but if possible I'd like to > just > > limit the number of retries. Is there a setting I'm missing, maybe? > > It should not be set to a low value, the default is one day. The timer is > reset every time when the transfer goes over "high watermark". So when the > transfer starts over and does not reach the high watermark for the > specified in xfer:timeout time, the transfer times out and fails. > > -- > Alexander. > > > On Wed, Apr 13, 2016 at 8:46 PM, Nate Sutton <[email protected]> > > wrote: > > > > > What should I be setting this to? I don't quite understand how setting > a > > > timeout will fix this issue, could you explain? lftp isn't stalling for > > > very long while downloading and intermittent stalls in transfers ought > to > > > be tolerated, so I wouldn't want to set it too low. And besides, the > error > > > message "recv: SSL_read: error:00000000:lib(0):func(0):reason(0)" > implies > > > that the peer shut down the connection, right? It seems in this case > that > > > limiting the number of retries when the peer terminates the connection > > > would be better, since otherwise it gets that error message and > retries the > > > transfer again and again forever. > > > > > > Thoughts? > > > > > > On Wed, Apr 13, 2016 at 5:00 AM, Alexander V. Lukyanov <[email protected]> > > > wrote: > > > > > >> On Tue, Mar 29, 2016 at 07:37:06PM -0500, Nate Sutton wrote: > > >> > I'm downloading from an HTTP server where it stops sending the file > at > > >> > about 40 MB and then stops sending data. lftp doesn't seem to handle > > >> this > > >> > very well and retries the transfer over and over and over, > indefinitely. > > >> > > > >> > https://gist.github.com/nate/e7e47d3a86118439c36a1877847d8b01 > > >> > > > >> > This happens with pget -n 5, pget -n 1, and get. > > >> > > > >> > Is this expected behavior? Is there a way to disable it? Or set a > max > > >> > number of retries? net:max-retries is already set to 3... > > >> > > >> Please test > > >> > > >> > https://github.com/lavv17/lftp/commit/989b10e928d73136ef2460572350f14a6a6d14c7 > > >> or http://lftp.yar.ru/ftp/devel/lftp-4.7.1.8-a7ceb-dirty.tar.gz > > >> which introduces new xfer:timeout setting. > > >> > > >> -- > > >> Alexander. > > >> > > > > > > > > > _______________________________________________ > > lftp mailing list > > [email protected] > > http://univ.uniyar.ac.ru/mailman/listinfo/lftp > _______________________________________________ lftp mailing list [email protected] http://univ.uniyar.ac.ru/mailman/listinfo/lftp