Re: packing directory storage

On Wed, 2004-06-23 at 18:48, Toby Dickenson wrote: 
> How badly is the web interface wedged? 

seriously and royally screwed up, no way to follow that route.  Probably
there is something else screwed though ... it's taking too long to solve
this issue, damn me.

> To pack without Zope in the loop:
> 
> 1. Shut down the zope or zeo process.
> 2. Run this script (untested; debugging might be necessary)
> 
> import time
> from DirectoryStorage.Full import Full as S
> from DirectoryStorage.Filesystem import Filesystem
> from ZODB.referencesf import referencesf as ZODB_referencesf
> fs = Filesystem('/var/lib/zope/var/dirstorage')
> storage = S(fs)
> # pack keeping 1 week of history
> storage.pack(time.time()-60*60*24*7,ZODB_referencesf) 

I will try this and report the time it took later.

> I would be interested to hear any statistics on a storage of that size.... how 
> long does it take to pack? how long does it take to run checkds? the output 
> from checkds with the -v switch would be interesting too.

this is the output (more or less, I was running it in screen that
apparently does not let you scroll the term view).  I launched the
checkds.py.

7098 maximum referencence graph depth
     470.5 average referencence graph depth
   4021818 revisions of objects
10489479067 total bytes
  40333205 bytes in transaction files
     48921 transactions
10449145862 bytes in object files
    425829 objects
done
           

this is the time output:
                                                                     
real    1063m11.333s
user    82m18.910s
sys     115m9.340s

regards
stef


-------------------------------------------------------
This SF.Net email sponsored by Black Hat Briefings & Training.
Attend Black Hat Briefings & Training, Las Vegas July 24-29 - 
digital self defense, top technical experts, no vendor pitches, 
unmatched networking opportunities. Visit www.blackhat.com