Re: Byteserver project status

--000000000000f14437058c032e73
Content-Type: text/plain; charset="UTF-8"
Content-Transfer-Encoding: quoted-printable

On Wed, Apr 17, 2019 at 9:21 AM =C3=89loi Rivard <[email protected]> wrote:

> Hello,
>

Apologies for the very late reply.


> I was wondering about the byteserver project
> <https://github.com/jimfulton/byteserver> status. The performance graph
> <https://github.com/jimfulton/byteserver/wiki/performance-2016-10-26>
> looks very promising,
>

It was a proof of concept that worked out well.


> but the project has not received attention since 3 years (there is also t=
his
> pull request <https://github.com/jimfulton/byteserver/pull/1> waiting for
> a few months).
>

Oops. :(


>
> Have you plans about developping this project, or was it just a proof of
> concept?
>

Well, I thought I would take it further. I even added support for using
msgpack for the ZEO protocol and client-side conflict resolution to ZEO to
enable it.

Consulting work took me in a different direction.


> Did you encounter technical difficulties?
>

No, at least nothing that more digging wouldn't address.


> Would you accept help to make it progress? If so, maybe creating
> exhaustive issues for the missing features would be a good point to start=
?
> What do you think?
>

I had plans for a new file-storage that addressed a number of issues in the
current file storage implemented as part of this work.  See
https://github.com/jimfulton/filestorage2.  Some major benefits:

   - Use less memory by leveraging memory mapping.
   - Make packing more incremental and less disruptive.

Since then, I've had opportunity to get more experience with memory mapping
which makes the filestorage2 ideas even more appealing to me.

Unfortunately, it's been a while since I've been able to use ZODB in my day
job :(, which makes it difficult for me to work on it.  I'm motivated and
informed by solving actual problems.

If you're interested, you might be better off forking it.

Jim

--=20
You received this message because you are subscribed to the Google Groups "=
zodb" group.
To unsubscribe from this group and stop receiving emails from it, send an e=
mail to [email protected].
To view this discussion on the web visit https://groups.google.com/d/msgid/=
zodb/CAPDm-FgFsYAOhTQRo%3DG3m9BF1UEWWpn9gL7U_QMX0nKrXiaewA%40mail.gmail.com=
.
For more options, visit https://groups.google.com/d/optout.

--000000000000f14437058c032e73
Content-Type: text/html; charset="UTF-8"
Content-Transfer-Encoding: quoted-printable

<div dir=3D"auto"><div dir=3D"ltr"><div dir=3D"ltr"><br></div><br><div clas=
s=3D"gmail_quote"><div dir=3D"ltr" class=3D"gmail_attr">On Wed, Apr 17, 201=
9 at 9:21 AM =C3=89loi Rivard &lt;<a href=3D"mailto:[email protected]" targe=
t=3D"_blank" rel=3D"noreferrer">[email protected]</a>&gt; wrote:<br></div><b=
lockquote class=3D"gmail_quote" style=3D"margin:0px 0px 0px 0.8ex;border-le=
ft:1px solid rgb(204,204,204);padding-left:1ex"><div dir=3D"ltr"><div>Hello=
,</div></div></blockquote><div><br></div><div>Apologies for the very late r=
eply.</div><div>=C2=A0</div><blockquote class=3D"gmail_quote" style=3D"marg=
in:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1e=
x"><div dir=3D"ltr"><div>I was wondering about the <a href=3D"https://githu=
b.com/jimfulton/byteserver" target=3D"_blank" rel=3D"noreferrer">byteserver=
 project</a> status. The <a href=3D"https://github.com/jimfulton/byteserver=
/wiki/performance-2016-10-26" target=3D"_blank" rel=3D"noreferrer">performa=
nce graph</a> looks very promising,</div></div></blockquote><div><br></div>=
<div>It was a proof of concept that worked out well.</div><div>=C2=A0<br></=
div><blockquote class=3D"gmail_quote" style=3D"margin:0px 0px 0px 0.8ex;bor=
der-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir=3D"ltr"><div=
> but the project has not received attention since 3 years (there is also <=
a href=3D"https://github.com/jimfulton/byteserver/pull/1" target=3D"_blank"=
 rel=3D"noreferrer">this pull request</a> waiting for a few months).</div><=
/div></blockquote><div><br></div><div>Oops. :(</div><div>=C2=A0</div><block=
quote class=3D"gmail_quote" style=3D"margin:0px 0px 0px 0.8ex;border-left:1=
px solid rgb(204,204,204);padding-left:1ex"><div dir=3D"ltr"><div><br></div=
><div>Have you plans about developping this project, or was it just a proof=
 of concept?</div></div></blockquote><div><br></div><div>Well, I thought I =
would take it further. I even added support for using msgpack for the ZEO p=
rotocol and client-side conflict resolution to ZEO to enable it.</div><div>=
<br></div><div>Consulting work took me in a different=C2=A0direction.</div>=
<div>=C2=A0</div><blockquote class=3D"gmail_quote" style=3D"margin:0px 0px =
0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir=
=3D"ltr"><div>Did you encounter technical difficulties?<br></div></div></bl=
ockquote><div><br></div><div>No, at least nothing that more digging wouldn&=
#39;t address.</div><div>=C2=A0</div><blockquote class=3D"gmail_quote" styl=
e=3D"margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);paddin=
g-left:1ex"><div dir=3D"ltr"><div></div><div>Would you accept help to make =
it progress? If so, maybe creating exhaustive issues for the missing featur=
es would be a good point to start? What do you think?<br></div></div></bloc=
kquote><div><br></div><div>I had plans for a new file-storage that addresse=
d a number of issues in the current file storage implemented as part of thi=
s work.=C2=A0 See=C2=A0<a href=3D"https://github.com/jimfulton/filestorage2=
" target=3D"_blank" rel=3D"noreferrer">https://github.com/jimfulton/filesto=
rage2</a>.=C2=A0 Some major benefits:</div><div><ul><li>Use less memory by =
leveraging memory mapping.</li><li>Make packing more incremental and less d=
isruptive.</li></ul></div><div>Since then, I&#39;ve had opportunity to get =
more experience with memory mapping which makes the filestorage2 ideas even=
 more appealing to me.</div><div><br></div><div>Unfortunately, it&#39;s bee=
n a while since I&#39;ve been able to use ZODB in my day job :(, which make=
s it difficult for me to work on it.=C2=A0 I&#39;m motivated and informed b=
y solving actual problems.</div><div><br></div><div>If you&#39;re intereste=
d, you might be better off forking it.</div><div dir=3D"auto"><br></div><di=
v dir=3D"auto">Jim</div></div></div></div>

<p></p>

-- <br />
You received this message because you are subscribed to the Google Groups &=
quot;zodb&quot; group.<br />
To unsubscribe from this group and stop receiving emails from it, send an e=
mail to <a href=3D"mailto:[email protected]">zodb+unsubscri=
[email protected]</a>.<br />
To view this discussion on the web visit <a href=3D"https://groups.google.c=
om/d/msgid/zodb/CAPDm-FgFsYAOhTQRo%3DG3m9BF1UEWWpn9gL7U_QMX0nKrXiaewA%40mai=
l.gmail.com?utm_medium=3Demail&utm_source=3Dfooter">https://groups.google.c=
om/d/msgid/zodb/CAPDm-FgFsYAOhTQRo%3DG3m9BF1UEWWpn9gL7U_QMX0nKrXiaewA%40mai=
l.gmail.com</a>.<br />
For more options, visit <a href=3D"https://groups.google.com/d/optout">http=
s://groups.google.com/d/optout</a>.<br />

--000000000000f14437058c032e73--