RelStorage shared blobs packing

Thierry Florac <[email protected]> Tue, 6 Nov 2018 10:22:13 +0100
Newsgroups gmane.comp.web.zope.zodb
Message-ID <CAPX_VWDCSwp5XEWviv1itwVBLzYc+kY++EFyjFH5xR7fkRP+xQ@mail.gmail.com>
--00000000000028bc860579fb8a28
Content-Type: text/plain; charset="UTF-8"

Hi,

I'm currently working on a Pyramid/ZODB based application using RelStorage
(release 2.1.0, with Python 3.5 and a PostgreSQL database).
Blobs are stored on the filesystem using a shared blobs directory.

Here is my configuration file:

%import relstorage

<zodb>
>     <relstorage>
>         keep-history false
>         blob-dir /var/local/env/website/var/db/blobs
>         shared-blob-dir yes
>         <postgresql>
>             dsn host='xxx' port='5432' dbname='xxx' user='xxx' password='
> xxx'
>         </postgresql>
>     </relstorage>
>     cache-size 100000
> </zodb>


Storage is configured without keeping history, but blobs are not removed
from filesystem when an object is deleted, or when packing the database!

So my question is simple: how can I remove unused blobs from filesystem?

Best regards,
Thierry
-- 
http://www.imagesdusport.com -- http://pyams.readthedocs.io

-- 
You received this message because you are subscribed to the Google Groups "zodb" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [email protected].
For more options, visit https://groups.google.com/d/optout.

--00000000000028bc860579fb8a28
Content-Type: text/html; charset="UTF-8"
Content-Transfer-Encoding: quoted-printable

<div dir=3D"ltr"><div dir=3D"ltr"><div class=3D"gmail_default" style=3D"fon=
t-family:monospace,monospace;color:rgb(120,63,4)">Hi,</div><div class=3D"gm=
ail_default" style=3D"font-family:monospace,monospace;color:rgb(120,63,4)">=
<br></div><div class=3D"gmail_default" style=3D"font-family:monospace,monos=
pace;color:rgb(120,63,4)">I&#39;m currently working on a Pyramid/ZODB based=
 application using RelStorage (release 2.1.0, with Python 3.5 and a Postgre=
SQL database).</div><div><div class=3D"gmail_default" style=3D"font-family:=
monospace,monospace;color:rgb(120,63,4)">Blobs are stored on the filesystem=
 using a shared blobs directory.</div><div class=3D"gmail_default" style=3D=
"font-family:monospace,monospace;color:rgb(120,63,4)"><br></div><div class=
=3D"gmail_default" style=3D"font-family:monospace,monospace;color:rgb(120,6=
3,4)">Here is my configuration file:</div></div><div class=3D"gmail_default=
" style=3D"font-family:monospace,monospace;color:rgb(120,63,4)"><br></div><=
blockquote style=3D"margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,=
204,204);padding-left:1ex" class=3D"gmail_quote"><span class=3D"gmail_defau=
lt" style=3D"font-family:monospace,monospace;color:rgb(120,63,4)"></span><s=
pan class=3D"gmail_default" style=3D"font-family:monospace,monospace;color:=
rgb(120,63,4)"></span><span style=3D"font-family:monospace,monospace">%impo=
rt relstorage</span>=C2=A0</blockquote><blockquote style=3D"margin:0px 0px =
0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex" class=3D=
"gmail_quote"><span style=3D"color:rgb(120,63,4);font-family:monospace,mono=
space"></span></blockquote><blockquote style=3D"margin:0px 0px 0px 0.8ex;bo=
rder-left:1px solid rgb(204,204,204);padding-left:1ex" class=3D"gmail_quote=
"><font face=3D"monospace, monospace">&lt;zodb&gt;</font><br><font face=3D"=
monospace, monospace"><span class=3D"gmail_default" style=3D"font-family:mo=
nospace,monospace;color:rgb(120,63,4)">=C2=A0 =C2=A0 </span>&lt;relstorage&=
gt;</font><br><font face=3D"monospace, monospace"><span class=3D"gmail_defa=
ult" style=3D"font-family:monospace,monospace;color:rgb(120,63,4)">=C2=A0 =
=C2=A0 =C2=A0 =C2=A0 </span>keep-history false</font><br><font face=3D"mono=
space, monospace"><span class=3D"gmail_default" style=3D"font-family:monosp=
ace,monospace;color:rgb(120,63,4)">=C2=A0 =C2=A0 =C2=A0 =C2=A0 </span>blob-=
dir /var/local/env/website/var/db/blobs</font><br><font face=3D"monospace, =
monospace"><span class=3D"gmail_default" style=3D"font-family:monospace,mon=
ospace;color:rgb(120,63,4)">=C2=A0 =C2=A0 =C2=A0 =C2=A0 </span>shared-blob-=
dir yes</font><br><font face=3D"monospace, monospace"><span class=3D"gmail_=
default" style=3D"font-family:monospace,monospace;color:rgb(120,63,4)">=C2=
=A0 =C2=A0 =C2=A0 =C2=A0 </span>&lt;postgresql&gt;</font><br><font face=3D"=
monospace, monospace"><span class=3D"gmail_default" style=3D"font-family:mo=
nospace,monospace;color:rgb(120,63,4)">=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =
=C2=A0 </span>dsn host=3D&#39;<span class=3D"gmail_default" style=3D"font-f=
amily:monospace,monospace;color:rgb(120,63,4)">xxx</span>&#39; port=3D&#39;=
5432&#39; dbname=3D&#39;<span class=3D"gmail_default" style=3D"font-family:=
monospace,monospace;color:rgb(120,63,4)">xxx</span>&#39; user=3D&#39;<span =
class=3D"gmail_default" style=3D"font-family:monospace,monospace;color:rgb(=
120,63,4)">xxx</span>&#39; <span class=3D"gmail_default" style=3D"font-fami=
ly:monospace,monospace;color:rgb(120,63,4)"></span>password=3D&#39;<span cl=
ass=3D"gmail_default" style=3D"font-family:monospace,monospace;color:rgb(12=
0,63,4)">xxx</span>&#39;</font><br><font face=3D"monospace, monospace"><spa=
n class=3D"gmail_default" style=3D"font-family:monospace,monospace;color:rg=
b(120,63,4)">=C2=A0 =C2=A0 =C2=A0 =C2=A0 </span>&lt;/postgresql&gt;</font><=
br><font face=3D"monospace, monospace"><span class=3D"gmail_default" style=
=3D"font-family:monospace,monospace;color:rgb(120,63,4)">=C2=A0 =C2=A0 </sp=
an>&lt;/relstorage&gt;</font><br><font face=3D"monospace, monospace"><span =
class=3D"gmail_default" style=3D"font-family:monospace,monospace;color:rgb(=
120,63,4)">=C2=A0 =C2=A0 </span>cache-size 100000</font><br><font face=3D"m=
onospace, monospace">&lt;/zodb&gt;</font></blockquote></div><blockquote sty=
le=3D"margin:0 0 0 40px;border:none;padding:0px"><font face=3D"monospace, m=
onospace"><span class=3D"gmail_default" style=3D"font-family:monospace,mono=
space;color:rgb(120,63,4)"></span><br></font></blockquote><div dir=3D"ltr">=
<div><div class=3D"gmail_default" style=3D"color:rgb(120,63,4)"><font face=
=3D"monospace, monospace">S</font><span style=3D"font-family:monospace,mono=
space">torage is configured without keeping history, but blobs are not remo=
ved from filesystem when an object is deleted, or when packing the database=
!</span></div><div class=3D"gmail_default" style=3D"font-family:monospace,m=
onospace;color:rgb(120,63,4)"><br></div><div class=3D"gmail_default" style=
=3D"font-family:monospace,monospace;color:rgb(120,63,4)">So my question is =
simple: how can I remove unused blobs from filesystem?</div><br></div><div>=
<div class=3D"gmail_default" style=3D"font-family:monospace,monospace;color=
:rgb(120,63,4)">Best regards,</div><div class=3D"gmail_default" style=3D"fo=
nt-family:monospace,monospace;color:rgb(120,63,4)">Thierry</div></div>-- <b=
r><div dir=3D"ltr" class=3D"gmail_signature"><div dir=3D"ltr"><div><a href=
=3D"http://www.imagesdusport.com" target=3D"_blank">http://www.imagesduspor=
t.com</a> -- <a href=3D"http://pyams.readthedocs.io" target=3D"_blank">http=
://pyams.readthedocs.io</a></div></div></div></div></div>

<p></p>

-- <br />
You received this message because you are subscribed to the Google Groups &=
quot;zodb&quot; group.<br />
To unsubscribe from this group and stop receiving emails from it, send an e=
mail to <a href=3D"mailto:[email protected]">zodb+unsubscri=
[email protected]</a>.<br />
For more options, visit <a href=3D"https://groups.google.com/d/optout">http=
s://groups.google.com/d/optout</a>.<br />

--00000000000028bc860579fb8a28--