Re: Doubt about where leave File objects

On Tuesday 25 January 2005 17:24, Santi Camps wrote:
> Hi all,
> 
> First of all, congratulations for your great work.  DirectoryStorage is 
> really impresive, a magnific product.   I'm using it intensively in 
> production and it really works fine.   By now, my great database is 
> about 6 Gb size and working very well.
> 
> Despite of this, I've a design doubt of my software.   Nowadays, I'm 
> storing all Files and its data as objects in ZODB.  In fact, 4.5 Gb of 
> my 6 Gb database are Files.  It could take a little effort maintain the 
> Files as objects in ZODB but put its data somewhere in the filesystem.   
> A change like this one, will improve DirStorage performance in some way 
> ?   I know that it could affect Zope caches and so on, and also is 
> obvious that packs and backups will take few time, I'm just asking if 
> this could help DirectoryStorage in its normal work.   Is better to 
> maintain storages as little as possible ?  Or DirStorage can work with 
> 30 Gb as better as with 6 Gb ?

Yes, it does seem a little unnecessary to store files in an object database, 
then store the objects in files. This cant be solved at the storage level.... 
All DirectoryStorage sees of the data is opaque pickles. It cant tell which 
objects contain flat files, rather than more structured data.

There are some moves so solve this at ZODB level. See the thread starting 
here: http://mail.zope.org/pipermail/zodb-dev/2005-January/008385.html
Any features that come out of that work I would like to support in 
DirectoryStorage too, but that is unlikely to happen without sponsorship or a 
volunteer :-(

-- 
Toby Dickenson

____________________

Important Notice:

This email and any attachments are confidential and may contain trade secrets or be legally privileged. If you have received this email in error you must not use, rely upon, disclose, copy or distribute the contents. Please reply to the sender so that proper delivery can be arranged and delete the email from your computer.
Gemini Data Loggers monitor incoming and outgoing email to ensure satisfactory customer service, maintain company security and prevent abuse of their email system. However, any views expressed in this email are not necessarily those of Gemini and Gemini cannot be held responsible for the content.
Gemini makes best efforts to ensure emails are virus free; however you are advised to carry out your own checks. Gemini does not accept responsibility for any damage resulting from email viruses.
____________________



-------------------------------------------------------
This SF.Net email is sponsored by: IntelliVIEW -- Interactive Reporting
Tool for open source databases. Create drag-&-drop reports. Save time
by over 75%! Publish reports on the web. Export to DOC, XLS, RTF, etc.
Download a FREE copy at http://www.intelliview.com/go/osdn_nl