Re: [Fwd: Re: [Dirstorage-users] [Fwd: directorystorage and ext3?]]
Jean-Marc Orliaguet <[email protected]>
| Newsgroups | gmane.comp.web.zope.cps.devel,gmane.comp.web.zope.zodb.dirstorage |
|---|---|
| Organization | Chalmers |
| Message-ID | <[email protected]> |
Dario Lopez-Kästen wrote: > > > -------- Original Message -------- > Subject: Re: [Dirstorage-users] [Fwd: [CPS-devel] directorystorage and > ext3?] > Date: Thu, 12 May 2005 11:10:57 -0400 > From: Paul Winkler <[email protected]> > To: dirstorage-users-5NWGOfrQmneRv+LV9MX5uipxlwaOVQ5f@public.gmane.org > References: <[email protected]> > > On Thu, May 12, 2005 at 12:32:08PM +0200, Dario Lopez-K?sten wrote: > >> -------- Original Message -------- >> Subject: [CPS-devel] directorystorage and ext3? >> Date: Thu, 12 May 2005 12:30:20 +0200 >> From: Jean-Marc Orliaguet <[email protected]> >> Organization: Chalmers >> To: L-CPS-devel <[email protected]> >> >> Hi! >> >> Are there any reports of large CPS3 sites running with ZEO / >> DirectoryStorage + ext3 compared to DS + reiserfs? > > > At my workplace, we don't run CPS, just a customized CMFDefault and > a bunch of legacy vanilla-zope stuff; but our primary development > environment > has been using ZEO and a "bushy" DirectoryStorage on an ext3 filesystem > for well over a year now, with no problems whatsoever. > > I'm not sure of uncompressed size, but compressed full backup is > currently 3.1 GB. > > We do run reiserfs on the production systems. > Hi! according to the benchmarks I'd done so far, ext3 does not seem to scale well after 3 or 4GB of data (corresponding to ~ 400.000 small files in the storage) I've simply uploaded documents: - 1000 x 2MB image attachment - 1000 x 80Kb pdf file (this also includes a transformation from pdf to text) and measured the time that it takes to upload each document: 1000x 2MB image - http://www.medic.chalmers.se/~jmo/dokarkiv/perf-2.pdf + 1000 x 80kb pdf file - http://www.medic.chalmers.se/~jmo/dokarkiv/perf-3.pdf It seems that directory storage does a transaction flush every ten document or so, which knocks ext3 out. Apart from that the figures with reiserfs3 have reached a plateau (1-2 seconds / document) whereas the ext3 figures keep on increasing. regards /JM _______________________________________________ cps-devel mailing list http://lists.nuxeo.com/mailman/listinfo/cps-devel