Need help with (really) huge site

Hello list,

 

I found sitecopy some days ago and started using it for the servers I
maintain. Everything works fine so far- but I have one project that just
doesn't work because it's too huge.

 

I have a directory with about 5000 sub-directories, each of these
sub-directories has 3 sub-directories and these contain about 100
.jpg-files each. I gave sitecopy about 1 day of CPU time - then my SSH
client shutdown due to a reconnect - I could run it via cron - but 1 day
is just too long for a single job. 

 

What I'd like to do to solve this problem is to split the job let's say
1 job per starting letter  - eg. copy all directories named
/home/mydir/a* to backup-server, then /home/mydir/b* etc.

 

I tried to do this by excluding all other directories like this 

 

exclude /home/mydir/b*

exclude /home/mydir/c*

exclude /home/mydir/d*

...

 

...but this doesn't work - I suppose sitecopy scans all the other files
anyway and doesn't completely ignore the content of the directory
excluded.

 

And ideas to solve my problem - perhaps a hint where I can find the scan
function in the C source ...then I might be able to patch and recompile
myself.

...but any "clean" solution would be great, too!

 

Kind regards,

Kai

_______________________________________________
sitecopy maillist  -  [email protected]
http://dav.lyra.org/mailman/listinfo/sitecopy