Re: [ZODB-Dev] Splitting a large ZODB file storage - any light-weight approach?
Jens Vagelpohl <[email protected]>
| Newsgroups | gmane.comp.web.zope.devel |
|---|---|
| Message-ID | <[email protected]> |
-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 Andreas Jung wrote: > Hi there, > > we have some huge ZODB file storage (60-80 GB each) and we want > to split the storage into a number of smaller storage (easier > to handle for backup and packing). The storages themselves only > contain a few (Zope 2) folders - let's say folders A, B, C - > within the root and we want to create seperate storages for A, B, C. > > Is there some easier approach than using the Zope 2 CopyManager API > for moving data around. The ZODB storage iterator API comes to my mind... > is this a suitable approach or is there some other light-weight approach > (compared to using CopyManager API)? Why move any data between ZODBs at all? In this situation I would try the following: - create a new empty ZODB. This one holds the root. - copy the old Data.fs into three new storage server buildouts. Attach to each with a ZEO client and delete the folders you do not need in that particular storage in the ZMI or via zopectl debug. - pack each storage so the deleted data gets trashed and the files shrink. - mount the "folder" storages into the new empty root using mount points on the clients that will use the storages. jens -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.8 (Darwin) iEYEARECAAYFAks7CpEACgkQRAx5nvEhZLKjYgCdGI71f/yNJS3EIpZxkyFVBmSe qhMAoJ8RBK2eq27P67Iki4h4MYMZ1kZB =FC8f -----END PGP SIGNATURE----- _______________________________________________ Zope-Dev maillist - [email protected] https://mail.zope.org/mailman/listinfo/zope-dev ** No cross posts or HTML encoding! ** (Related lists - https://mail.zope.org/mailman/listinfo/zope-announce https://mail.zope.org/mailman/listinfo/zope )