Re: Re: Python-3-Migration of existing Data.fs

Arthur LEDARD <[email protected]> Tue, 20 Mar 2018 14:02:49 +0000
Newsgroups gmane.comp.web.zope.zodb
Message-ID <CAGngERhE6r3ROvUZL8FjgT+7D9DvMwct1_-pPz=AMRjTz43-tw@mail.gmail.com>
I have a sample code to reproduce the problem.
I can share maybe on github?

I’m afraid I’m not explicitely using oid, just an old good OOBTree,
containing OOBTree.

Arthur

2018-03-20 13:51 GMT+00:00 Jim Fulton <[email protected]>:

> On Tue, Mar 20, 2018 at 6:22 AM, Arthur LEDARD <[email protected]>
> wrote:
>
>> Hi,
>>
>> I’m trying to migrate my Data.fs.
>> I use your code, but I’m stuck with a non expected problem.
>>
>> Using python2, my oid are pickled in a format
>> "U\x08\x00\x00\x00\x00\x00\x00\x03\xeaq\x03"
>> The format seems correct, but is not understood with python3 :
>> UnicodeDecodeError.
>>
>
> Ouch.
>
>
>>
>> I was expecting to have problems with data, not oid.
>>
>
> I assume you're storing oids in your data somewhere.  Can you confirm?
>
> I happen to like this pattern (as opposed to generating ids at the
> application level), but I can see how this might be a headache in the
> transition to Python 3.
>
> Did you face this problem?
>> Did you succeed in your migrations?
>>
>
> I suspect they were focussed on providing a tool for future migrations,
> but am curious about any experience they might have.
>
> Jim
>
>
>>
>> Regards,
>>
>> Arthur
>> Le lundi 23 mai 2016 16:48:18 UTC+1, mh a écrit :
>>>
>>> Hi,
>>>
>>> at "Berlin Strategic sprint 2016“ [1] Florian Pilz and me developed a
>>> tool to analyze a ZODB Filestorage for Python 2 string objects. When they
>>> are in an encoding besides ASCII this would prevent using this Filestorage
>>> with Python 3 because of decoding errors arising on loading the pickles.
>>> The tool is even able to convert those strings either to unicode by
>>> decoding them using a configurable encoding or convert them to
>>> `zodbpickle.binary` so Python 3 will read them as `bytes`.
>>> See [3] for the documentation of the tool and [2] for the repository on
>>> GitHub.
>>>
>>> * Is there already another tool for this analysis/migration?
>>> * Is there already any practical knowledge migrating Filestorage
>>> contents to Python 3?
>>> * Do you think such a tool is the right approach to achieve such a
>>> migration?
>>> * Is there anyone who wants to try out the tool on a Filestorage of a
>>> personal project and share the experiences? (I analyzed two projects where
>>> I have access to a Filestorage but I am sure this does not catch all the
>>> edge cases.)
>>>
>>>
>>>
>>> [1] http://gil.badall.net/2016/05/20/berlin-2016-sprint-update/
>>> [2] https://github.com/gocept/zodb.py3migrate
>>> [3] https://pythonhosted.org/zodb.py3migrate/
>>>
>>> --
>>> Michael Howitz · [email protected] · software developer
>>> gocept gmbh & co. kg · Forsterstraße 29 · 06112 Halle (Saale) · Germany
>>> <https://maps.google.com/?q=Forsterstra%C3%9Fe+29+%C2%B7+06112+Halle+(Saale)+%C2%B7+Germany&entry=gmail&source=g>
>>> http://gocept.com · Tel +49 345 1229889-8 <+49%20345%2012298898>
>>> Python, Pyramid, Plone, Zope · consulting, development, hosting,
>>> operations
>>>
>>> --
>> You received this message because you are subscribed to the Google Groups
>> "zodb" group.
>> To unsubscribe from this group and stop receiving emails from it, send an
>> email to [email protected].
>> For more options, visit https://groups.google.com/d/optout.
>>
>
>
>
> --
> Jim Fulton
> http://jimfulton.info
>

-- 
You received this message because you are subscribed to the Google Groups "zodb" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [email protected].
For more options, visit https://groups.google.com/d/optout.