Re: importing and merging caches

mi <[email protected]> writes:

> A related question to Felix' issue, just for my interest.
> 
> I wonder if it's possible to merge two existing caches on two different computers that are
> not necessarily connected ?
> 
> Importing sites on a wwwoffle should be no problem with wget.
> But how to 'spit out' all the conetent of a cache in a form that can be fed to wget ? 
> So that it even works with a dvd transfer ?

This is just far too complicated.

> ok, here's my quickshot:
> Say, we are to merge the cache from wwwoffle (A) on one computer into the wwwoffle (B) on another
> machine. 
> We set up a second new wwwoffle instance (B') on (B), and copy the cache (A) to wwwoffle (B').
> Then fetch from (B) anything stored on (B'), recursively.
> 
> Sounds complicated, though. And is it possible at all ? 
> And how exactly fetching 'anything stored on cache (B') ??
> 
> Perhaps one of our commandline artists got idea :) ?

Just copy the cache files (in /var/spool/wwwoffle/http and ftp) from
machine A to the same location on machine B.  You can just use tar to
create a copy of the cache from machine A, copy the tar file to
machine B and extract the files.  There might be some duplicate files
that are on A and B, but that is a problem with whatever method you
use.

-- 
Andrew.
----------------------------------------------------------------------
Andrew M. Bishop                             amb-Uxr6IM1mbv2TY6FTCsQk+9Bc4/[email protected]
                                      http://www.gedanken.demon.co.uk/

WWWOFFLE users page:
        http://www.gedanken.demon.co.uk/wwwoffle/version-2.8/user.html