Re: fetch in autodial mode fetches only one url per server

Max Kirillov <max630-JGs/[email protected]> writes:

> > When I invoke "$wwwoffle -fetch" while wwwoffle is in
> > autodial mode, the `max-fetch-servers` fetch processes
> > started. After each of them finished, it does not start
> > fetchinng another outgoing url. As a result, only
> > `max-fetch-servers` documents are fetched during one fetch
> > session. The desired behavior is fetching all documents that
> > are to be fetched.

If you are using autodial mode then I didn't expect you to run
'wwwoffle -fetch'.  In autodial mode WWWOFFLE will go and get pages
that you don't have like it would if you are online, but will only
show the cached version of a page that you already have.  Using
'wwwoffle -fetch' doesn't make much sense in this case because there
are never any requests recorded.

> > The version in question is 2.8e.
> 
> > I did not perform the full research yet, but I suspect that
> > the following patch will fix the bug. Please note that I did
> > not test it (yet)!
> 
> I've applied the patch to my installation. Seems to fix the
> problem.

This patch will make the autodial mode work the same as online mode
for fetching which is what you want.  Thanks for the patch, it will be
in the next version.

-- 
Andrew.
----------------------------------------------------------------------
Andrew M. Bishop                             amb-Uxr6IM1mbv2TY6FTCsQk+9Bc4/[email protected]
                                      http://www.gedanken.demon.co.uk/

WWWOFFLE users page:
        http://www.gedanken.demon.co.uk/wwwoffle/version-2.8/user.html