Re: block while fetching

Joerg Sommer <[email protected]> writes:

> if I request a file, that is currently fetched, I get a half file. It
> looks like wwwoffle doesn't observe that the file isn't complete, if it
> is requested by another user while -fetch is running.
> 
> Example: While offline I request
> ftp://ftp.kernel.org/.../kernel-2.6.8.tar.gz. When I go online the next
> time wwwoffle fetches kernel-2.6.8.tar.gz. If I run wget .../kernel...
> while the fetching process is running I get an incomplete file.

There is an option in WWWOFFLE called lock-files to ensure that two
processes will not try to fetch the same URL at the same time.  This
option is disabled by default.  A long time ago there were problems
with this option (but they are fixed now) which is why it is disabled
by default.

The option works by creating a lock file when starting to fetch the
data for a URL and deleting the file when finished.  If another
process tries to fetch the same URL then it will wait for a short
while before reporting an error.  The reason that the second process
does not block totally is that an error with the lock files could
cause all of the WWWOFFLE processes to be blocked.

-- 
Andrew.
----------------------------------------------------------------------
Andrew M. Bishop                             amb-Uxr6IM1mbv2TY6FTCsQk+9Bc4/[email protected]
                                      http://www.gedanken.demon.co.uk/

WWWOFFLE users page:
        http://www.gedanken.demon.co.uk/wwwoffle/version-2.8/user.html