Re: Using mmap as a storage

On Wed, Jun 13, 2018 at 1:20 PM, <[email protected]> wrote:

> Is there a way for me to pass an already opened file object to
> ZOOB.FileStorage?


No.  Keep in mind, however, that this is open source. :)  You could fork
FileStorage and, for example, have it mmap internally.



>   I would like to compare the performance of using FileStorage with a
> filename and using FileStorage with an mmap.
>

For read-only access?  Even if you were thinking of read-write access,
which I'd be a little skeptical of, a read-only test would be an
interesting experiment. I'd be very interested to here what you learn.

An especially interesting and low-risk experiment might be to compare
current packing and packing using mmap, either with the built-in code or
zc.FileStorage, https://github.com/zopefoundation/zc.FileStorage.

Also, does ZOOB already use the mmap module internally?


No, however, in a notional next-generation file storage,
https://github.com/jimfulton/filestorage2, I plan to use mmapped indexes
for older data.


> I know there are problems potentially using that over NFS, and so I want
> to be careful here.
>

I would *never ever ever* use a network file system for a database.

Jim

-- 
Jim Fulton
http://jimfulton.info

-- 
You received this message because you are subscribed to the Google Groups "zodb" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [email protected].
For more options, visit https://groups.google.com/d/optout.