Re: Best option for blobs storage

> On Mar 17, 2018, at 10:05, Thierry Florac <[email protected]> wrote:
> 
> I would like to migrate a ZODB application from ZEO to RelStorage (with a PostgreSQL database).

What versions of ZODB, RelStorage and PostgreSQL are you using? Also, what PostgreSQL driver (psycopg2?) and driver version are you using? 

> The application (built on top of Pyramid) is deployed on a cluster of several web application servers (with three virtual servers using five application processes each) and is using many blobs to store images, videos...

> I was previously using ZEO blobs and until now I'm trying to use PostgreSQL blobs, but it doesn't seem to be as efficient and quick as ZEO blobs 

Could you share (an anonymised version of) your RelStorage configuration? And can you talk about about what kind of workflow your blobs go through (e.g., mostly small, frequently changing, very large, rarely changing, etc)? If blobs are rarely changing, I would expect both the local blob cache (shared-blob-dir=false) and the shared blob directory to be quite efficient for reading blobs: roughly as efficient as the equivalent ZEO setup, because much of the code is shared (the main thing different is the first download of the blob). (Note that ZEO defaults to a local blob cache, but RelStorage defaults to a shared blob directory: in production, my organisation uses the local blob cache, albeit on MySQL.) For blob changes, files less than 2GB directly use the PostgreSQL/psycopg2 native file copy support, which I would hope would be pretty efficient. 

Jason

-- 
You received this message because you are subscribed to the Google Groups "zodb" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [email protected].
For more options, visit https://groups.google.com/d/optout.